Jul 08 19:25:31 devstack cinder-volume[76022]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 19:25:31 devstack cinder-volume[76022]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 19:25:31 devstack cinder-volume[76022]: we strongly recommend against using it for new projects. Jul 08 19:25:31 devstack cinder-volume[76022]: If you are already using Eventlet, we recommend migrating to a different Jul 08 19:25:31 devstack cinder-volume[76022]: framework. For more detail see Jul 08 19:25:31 devstack cinder-volume[76022]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 19:25:31 devstack cinder-volume[76022]: import eventlet # noqa Jul 08 19:25:34 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:25:34 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:25:34 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:25:34 devstack cinder-volume[76022]: INFO dbcounter [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Registered counter for database cinder Jul 08 19:25:34 devstack cinder-volume[76022]: DEBUG oslo_db.sqlalchemy.engines [None req-30c38336-f451-4815-b435-d198f3f1936e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:25:35 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writer thread running {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 19:25:35 devstack cinder-volume[76022]: INFO cinder.rpc [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 19:25:35 devstack cinder-volume[76022]: INFO cinder.rpc [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 19:25:35 devstack cinder-volume[76022]: DEBUG oslo_db.sqlalchemy.engines [None req-30c38336-f451-4815-b435-d198f3f1936e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:25:35 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Determined volume DB was empty at startup. Jul 08 19:25:35 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76022) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 19:25:35 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 19:25:35 devstack cinder-volume[76022]: WARNING stevedore.named [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 19:25:35 devstack cinder-volume[76022]: WARNING castellan.key_manager [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:25:35 devstack cinder-volume[76022]: WARNING cinder.keymgr.conf_key_mgr [None req-30c38336-f451-4815-b435-d198f3f1936e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:25:35 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76022) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 19:25:35 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] CMD "cinder-rtstool verify" returned: 0 in 0.539s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_db.sqlalchemy.engines [None req-30c38336-f451-4815-b435-d198f3f1936e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:25:36 devstack cinder-volume[76022]: INFO cinder.rpc [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 19:25:36 devstack cinder-volume[76022]: INFO cinder.rpc [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 19:25:36 devstack cinder-volume[76022]: WARNING stevedore.named [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 19:25:36 devstack cinder-volume[76022]: WARNING castellan.key_manager [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:25:36 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_db.sqlalchemy.engines [None req-30c38336-f451-4815-b435-d198f3f1936e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:25:36 devstack cinder-volume[76022]: INFO oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Starting 1 workers Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Started child 76187 {{(pid=76022) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Full set of CONF: {{(pid=76022) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] ******************************************************************************** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Configuration options gathered from: {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] ================================================================================ {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] allow_availability_zone_fallback = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] allow_compression_on_image_upload = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] allowed_direct_url_schemes = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] api_rate_limit = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] auth_strategy = keystone {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] az_cache_duration = 3600 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_availability_zone = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_host = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_stats_polling_interval = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backup_api_class = cinder.backup.api.API {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backup_name_template = backup-%s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backup_use_same_host = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backup_use_temp_snapshot = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] chap_password = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] chap_username = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76187]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_internal_tenant_project_id = 8eea8a001f9f462e9d418dcf853033f6 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_internal_tenant_user_id = 28044381c52941489932542fa873987c {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cloned_volume_same_az = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cluster = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] compression_format = gzip {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] compute_api_class = cinder.compute.nova.API {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] config_dir = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] config_source = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] control_exchange = openstack {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] debug = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] default_availability_zone = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] default_group_type = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] default_volume_type = lvmdriver-1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] disk_geometry = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] driver_client_cert = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] driver_client_cert_key = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] driver_data_namespace = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] driver_ssl_cert_path = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] driver_ssl_cert_verify = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] driver_use_ssl = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] enable_force_upload = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] enable_new_services = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] enable_unsupported_driver = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] enforce_multipath_for_image_xfer = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] filter_function = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_api_insecure = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_api_servers = ['http://192.168.122.39/image'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_api_ssl_compression = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_ca_certificates_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_catalog_info = image:glance:publicURL {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_num_retries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance_request_timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] goodness_function = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] graceful_shutdown_timeout = 5 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] group_api_class = cinder.group.api.API {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] host = devstack {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_compress_on_upload = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_conversion_address_space_limit = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_conversion_cpu_limit = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_conversion_disable = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_upload_use_cinder_backend = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_upload_use_internal_tenant = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_volume_cache_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_volume_cache_max_count = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_volume_cache_max_size_gb = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] image_volume_cache_promote_across_pools = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] init_host_max_objects_retrieval = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] instance_format = [instance: %(uuid)s] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] iscsi_target_flags = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] iscsi_write_cache = on {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] iser_helper = tgtadm {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] iser_ip_address = 192.168.122.39 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] iser_port = 3260 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_color = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_config_append = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_dir = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_options = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_rotate_interval = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_rotate_interval_type = days {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] log_rotation_type = none {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] max_age = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] max_logfile_count = 30 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] max_logfile_size_mb = 200 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] max_over_subscription_ratio = 20.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] message_reap_interval = 86400 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] message_ttl = 2592000 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] migration_create_volume_timeout_secs = 300 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] monkey_patch = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] monkey_patch_modules = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] my_ip = 192.168.122.39 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] no_snapshot_gb_quota = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] num_iser_scan_tries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] num_shell_tries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] num_volume_device_scan_tries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] nvmeof_conn_info_version = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] nvmet_ns_id = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] nvmet_port_id = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_max_limit = 1000 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_volume_ext_list = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_volume_listen_port = 8776 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_volume_use_ssl = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] osapi_volume_workers = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] per_volume_size_limit = -1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] periodic_fuzzy_delay = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] periodic_interval = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] public_endpoint = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] publish_errors = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_backup_gigabytes = 1000 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_backups = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_gigabytes = 1000 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_groups = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_snapshots = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] quota_volumes = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] rate_limit_burst = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] rate_limit_except_level = CRITICAL {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] rate_limit_interval = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] reinit_driver_count = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] replication_device = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] report_discard_supported = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] report_interval = 120 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] reservation_clean_interval = 86400 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] reservation_expire = 86400 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] reserved_image_namespaces = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] reserved_percentage = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] rpc_response_timeout = 120 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] run_external_periodic_tasks = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] scst_target_driver = iscsi {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] scst_target_iqn_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_down_time = 720 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] shell_completion = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] snapshot_name_template = snapshot-%s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] snapshot_same_host = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] split_loggers = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] state_path = /opt/stack/data/cinder {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] storage_availability_zone = nova {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] storage_protocol = iSCSI {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] syslog_log_facility = LOG_USER {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] target_helper = lioadm {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] target_ip_address = 192.168.122.39 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] target_port = 3260 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] target_protocol = iscsi {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] target_secondary_ip_addresses = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] trace_flags = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] transport_url = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] until_refresh = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_chap_auth = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_default_quota_class = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_journal = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_json = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_multipath_for_image_xfer = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_stderr = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] use_syslog = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] verify_glance_signatures = enabled {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_api_class = cinder.volume.api.API {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_backend_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_clear = zero {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_clear_ionice = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_clear_size = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_copy_bps_limit = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_dd_blocksize = 1M {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_name_template = volume-%s {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_service_inithost_offload = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volume_usage_audit_period = month {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] zoning_mode = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_concurrency.disable_process_locking = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.auth_section = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.auth_type = password {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.auth_version = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.cache = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.include_service_catalog = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.insecure = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.interface = public {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_password = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcache_username = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.region_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.service_type = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.backend = dogpile.cache.null {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.backend_argument = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.backend_expiration_time = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.config_prefix = cache.oslo {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.debug_cache_backend = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.enable_retry_client = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.enable_socket_keepalive = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.expiration_time = 600 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.hashclient_retry_attempts = 2 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_dead_retry = 300 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_pool_maxsize = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_sasl_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.password = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.proxies = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.redis_db = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.redis_server = localhost:6379 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.retry_attempts = 2 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.retry_delay = 0.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.socket_keepalive_count = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.socket_keepalive_idle = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.socket_keepalive_interval = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.socket_timeout = 1.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.tls_allowed_ciphers = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.tls_cafile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.tls_certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.tls_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.tls_keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cache.username = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] coordination.backend_url = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.asyncio_connection = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.asyncio_slave_connection = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.backend = sqlalchemy {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.connection = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.connection_debug = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.connection_parameters = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.connection_recycle_time = 3600 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.connection_trace = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.db_inc_retry_interval = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.db_max_retries = 20 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.db_max_retry_interval = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.db_retry_interval = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.max_overflow = 50 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.max_pool_size = 5 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.max_retries = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.mysql_wsrep_sync_wait = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.pool_timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.retry_interval = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.slave_connection = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.sqlite_synchronous = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.synchronous_reader = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] database.use_db_reconnect = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.connection_string = messaging:// {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.es_doc_type = notification {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.es_scroll_size = 10000 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.es_scroll_time = 2m {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.filter_error_trace = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.hmac_keys = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.sentinel_service_name = mymaster {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.socket_timeout = 0.1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.trace_requests = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler.trace_sqlalchemy = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler_jaeger.process_tags = {} {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler_jaeger.service_name_prefix = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] profiler_otlp.service_name_prefix = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.enforce_new_defaults = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.enforce_scope = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.policy_default_rule = default {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.policy_file = policy.yaml {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.group = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.helper_command = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] privsep_osbrick.user = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.group = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.helper_command = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] cinder_sys_admin.user = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.auth_section = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.auth_type = password {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.cafile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.collect_timing = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.insecure = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.send_service_user_token = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.split_loggers = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] service_user.timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.auth_section = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.auth_type = password {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.collect_timing = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.insecure = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.region_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.split_loggers = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] glance.timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.backend_availability_zone = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.chap_password = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.chap_username = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.disk_geometry = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.driver_client_cert = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.driver_client_cert_key = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.driver_data_namespace = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.driver_use_ssl = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.extra_capabilities = {} {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.filter_function = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.goodness_function = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.image_volume_cache_promote_across_pools = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.iscsi_target_flags = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.iscsi_write_cache = on {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.iser_helper = tgtadm {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.iser_port = 3260 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.lvm_share_target = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.lvm_type = auto {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.num_shell_tries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.replication_device = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.report_discard_supported = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.reserved_percentage = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.target_helper = tgtadm {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.target_port = 3260 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.target_protocol = iscsi {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.trace_flags = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.unique_fqdn_network = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.use_chap_auth = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_backend_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_clear = zero {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_clear_ionice = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_clear_size = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_reports.file_event_handler = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_reports.log_dir = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.backend_host = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.chap_password = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.chap_username = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.disk_geometry = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.driver_client_cert = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.extra_capabilities = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.filter_function = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.goodness_function = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.image_volume_cache_promote_across_pools = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.iser_helper = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.iser_ip_address = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.iser_port = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.lvm_share_target = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.lvm_type = auto {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.num_shell_tries = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.replication_device = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.report_discard_supported = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.reserved_percentage = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.scst_target_driver = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.storage_protocol = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.target_helper = lioadm {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.target_ip_address = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.target_port = 3260 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.trace_flags = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.use_chap_auth = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_clear = zero {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_clear_size = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] lvmdriver-1.volumes_dir = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack sudo[76191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_notifications.driver = [] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_notifications.retry = -1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack sudo[76191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] key_manager.fixed_key = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.barbican_api_version = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.barbican_endpoint = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.barbican_endpoint_type = public {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.barbican_region_name = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.cafile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.collect_timing = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.insecure = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.number_of_retries = 60 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.retry_delay = 1 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.send_service_user_token = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.split_loggers = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.verify_ssl = True {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican.verify_ssl_path = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.auth_section = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.auth_type = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.cafile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.certfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.collect_timing = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.insecure = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.keyfile = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.split_loggers = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] barbican_service_user.timeout = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.approle_role_id = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.approle_secret_id = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.kv_mountpoint = secret {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.kv_path = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.kv_version = 2 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.namespace = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.root_token_id = **** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.ssl_ca_crt_file = None {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.timeout = 60.0 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.use_ssl = False {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:25:36 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] ******************************************************************************** {{(pid=76022) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 19:25:37 devstack sudo[76191]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:37 devstack sudo[76350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:37 devstack sudo[76350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:37 devstack sudo[76350]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.648s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:25:37 devstack cinder-volume[76187]: INFO cinder.brick.local_dev.lvm [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:37 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:37 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:25:37 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:38 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:38 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:38 devstack cinder-volume[76187]: DEBUG cinder.brick.local_dev.lvm [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76187) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 19:25:38 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:38 devstack sudo[76756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:38 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:39 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:39 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.242s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:39 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:39 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:39 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:39 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:39 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:40 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:40 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:40 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:40 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:40 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:40 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 19:25:40 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:41 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:41 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.689s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:41 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:41 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:25:41 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:41 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:41 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:41 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:41 devstack sudo[76977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:25:41 devstack sudo[76977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:42 devstack sudo[76977]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:42 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.891s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:42 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:42 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:42 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:43 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:43 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.902s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:43 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:43 devstack sudo[76996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:43 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:44 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:44 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:44 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:44 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:44 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:44 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:44 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:44 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:44 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:44 devstack cinder-volume[76187]: INFO cinder.volume.drivers.lvm [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 19:25:44 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:45 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:45 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:45 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:45 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:45 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:45 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.873s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:45 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:25:45 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:45 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:25:45 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:46 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:25:46 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:46 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:46 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:46 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:46 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:47 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:47 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:47 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:47 devstack sudo[77275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:47 devstack sudo[77275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:47 devstack sudo[77275]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:47 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:47 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:47 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:47 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:48 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:48 devstack cinder-volume[76187]: INFO cinder.volume.driver [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG cinder.volume.driver [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76187) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG oslo_db.sqlalchemy.engines [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writer thread running {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG cinder.db.sqlalchemy.api [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Building query based on filter {{(pid=76187) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG cinder.image.image_utils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76187) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 08 19:25:48 devstack cinder-volume[76187]: INFO cinder.keymgr.migration [None req-ba6f0d49-54c9-4f8d-a386-28edf7a23054 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:25:48 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:48 devstack sudo[77283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:25:48 devstack sudo[77283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:49 devstack sudo[77283]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:49 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:49 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:49 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:49 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:49 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:49 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:49 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:49 devstack sudo[77293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:49 devstack sudo[77293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:50 devstack sudo[77293]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:50 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:50 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:50 devstack sudo[77297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:50 devstack sudo[77297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:51 devstack sudo[77297]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:51 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:51 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:25:51 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Driver initialization completed successfully. Jul 08 19:25:51 devstack cinder-volume[76187]: INFO cinder.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Initiating service 2 cleanup Jul 08 19:25:51 devstack cinder-volume[76187]: INFO cinder.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Service 2 cleanup completed. Jul 08 19:25:51 devstack cinder-volume[76187]: DEBUG cinder.service [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Creating RPC server for service cinder-volume {{(pid=76187) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 19:25:51 devstack cinder-volume[76187]: DEBUG cinder.service [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76187) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 19:25:51 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 19:25:51 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:25:51 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:51 devstack sudo[77337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:25:51 devstack sudo[77337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:52 devstack sudo[77337]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:52 devstack sudo[77340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:52 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:52 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:52 devstack sudo[77397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:25:52 devstack sudo[77397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:53 devstack sudo[77397]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:53 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:53 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:25:53 devstack sudo[77404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:25:53 devstack sudo[77404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:25:54 devstack sudo[77404]: pam_unix(sudo:session): session closed for user root Jul 08 19:25:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:25:54 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-c22fef45-eb9c-4c92-8998-8c2bf22ff146 None None] Driver post RPC initialization completed successfully. Jul 08 19:26:01 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:26:04 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:26:54 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:26:54 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:26:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:26:54 devstack sudo[79109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:26:54 devstack sudo[79109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:26:54 devstack sudo[79109]: pam_unix(sudo:session): session closed for user root Jul 08 19:26:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:26:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:26:54 devstack sudo[79112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:26:54 devstack sudo[79112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:26:55 devstack sudo[79112]: pam_unix(sudo:session): session closed for user root Jul 08 19:26:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:26:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:26:55 devstack sudo[79124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:26:55 devstack sudo[79124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:26:56 devstack sudo[79124]: pam_unix(sudo:session): session closed for user root Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:26:56 devstack sudo[79145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:26:56 devstack sudo[79145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:26:56 devstack sudo[79145]: pam_unix(sudo:session): session closed for user root Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running periodic task VolumeManager._thread_info {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] thread count: 6 {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:26:56 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] thread info: [<_MainThread(MainThread, started 126442552475776)>, , , , , ] {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:27:54 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:27:54 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:27:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:27:54 devstack sudo[82405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:27:54 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:27:54 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root Jul 08 19:27:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:27:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:27:54 devstack sudo[82452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:27:54 devstack sudo[82452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:27:55 devstack sudo[82452]: pam_unix(sudo:session): session closed for user root Jul 08 19:27:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:27:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:27:55 devstack sudo[82459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:27:55 devstack sudo[82459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:27:56 devstack sudo[82459]: pam_unix(sudo:session): session closed for user root Jul 08 19:27:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:27:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:27:56 devstack sudo[82479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:27:56 devstack sudo[82479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:27:56 devstack sudo[82479]: pam_unix(sudo:session): session closed for user root Jul 08 19:27:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:27:56 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:28:04 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:28:04 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:28:54 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:28:54 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:28:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:28:54 devstack sudo[84458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:28:54 devstack sudo[84458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:28:54 devstack sudo[84458]: pam_unix(sudo:session): session closed for user root Jul 08 19:28:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:28:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:28:54 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:28:54 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:28:55 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Jul 08 19:28:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:28:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:28:55 devstack sudo[84502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:28:55 devstack sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:28:56 devstack sudo[84502]: pam_unix(sudo:session): session closed for user root Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:28:56 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:28:56 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:28:56 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running periodic task VolumeManager._thread_info {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] thread count: 6 {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:28:56 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] thread info: [<_MainThread(MainThread, started 126442552475776)>, , , , , ] {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:29:54 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:29:54 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 19:29:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:29:54 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 19:29:54 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:29:54 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Jul 08 19:29:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:29:54 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:29:54 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:29:54 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:29:55 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Jul 08 19:29:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:29:55 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:29:55 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 19:29:55 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:29:56 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Jul 08 19:29:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:29:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:29:56 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 19:29:56 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:29:56 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Jul 08 19:29:56 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:29:56 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-a7adaac5-bc0a-4720-b0f8-ab78dc97a98f None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:30:04 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:04 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:14 devstack cinder-volume[76022]: INFO oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Caught SIGTERM, stopping children Jul 08 19:30:14 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Acquiring lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:30:14 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Acquired lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:30:14 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Releasing lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:30:14 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Stop services. {{(pid=76022) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 19:30:14 devstack cinder-volume[76022]: DEBUG oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Killing children. {{(pid=76022) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 19:30:14 devstack cinder-volume[76022]: INFO oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Waiting on 1 children to exit Jul 08 19:30:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.lockutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Acquiring lock "singleton_lock" {{(pid=76187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:30:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.lockutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Acquired lock "singleton_lock" {{(pid=76187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:30:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.lockutils [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Releasing lock "singleton_lock" {{(pid=76187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:30:16 devstack cinder-volume[76187]: WARNING amqp [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 19:30:16 devstack cinder-volume[76187]: WARNING amqp [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 19:30:16 devstack cinder-volume[76022]: INFO oslo_service.backend._eventlet.service [None req-30c38336-f451-4815-b435-d198f3f1936e None None] Child 76187 exited with status 0 Jul 08 19:30:16 devstack cinder-volume[86320]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 19:30:16 devstack cinder-volume[86320]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 19:30:16 devstack cinder-volume[86320]: we strongly recommend against using it for new projects. Jul 08 19:30:16 devstack cinder-volume[86320]: If you are already using Eventlet, we recommend migrating to a different Jul 08 19:30:16 devstack cinder-volume[86320]: framework. For more detail see Jul 08 19:30:16 devstack cinder-volume[86320]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 19:30:16 devstack cinder-volume[86320]: import eventlet # noqa Jul 08 19:30:18 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:30:18 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:30:18 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:30:19 devstack cinder-volume[86320]: INFO dbcounter [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Registered counter for database cinder Jul 08 19:30:19 devstack cinder-volume[86320]: DEBUG oslo_db.sqlalchemy.engines [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:19 devstack cinder-volume[86320]: DEBUG dbcounter [-] [86320] Writer thread running {{(pid=86320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 19:30:19 devstack cinder-volume[86320]: INFO cinder.rpc [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 19:30:19 devstack cinder-volume[86320]: INFO cinder.rpc [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_db.sqlalchemy.engines [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:20 devstack cinder-volume[86320]: INFO cinder.volume.manager [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Determined volume DB was empty at startup. Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG cinder.volume.manager [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86320) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 19:30:20 devstack cinder-volume[86320]: INFO cinder.volume.manager [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 19:30:20 devstack cinder-volume[86320]: WARNING stevedore.named [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 19:30:20 devstack cinder-volume[86320]: WARNING castellan.key_manager [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:30:20 devstack cinder-volume[86320]: WARNING cinder.keymgr.conf_key_mgr [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:30:20 devstack cinder-volume[86320]: INFO cinder.volume.manager [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_db.sqlalchemy.engines [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:20 devstack cinder-volume[86320]: INFO oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Starting 1 workers Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Started child 86537 {{(pid=86320) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Full set of CONF: {{(pid=86320) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] ******************************************************************************** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Configuration options gathered from: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] ================================================================================ {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] allow_availability_zone_fallback = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] allow_compression_on_image_upload = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] allowed_direct_url_schemes = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] api_rate_limit = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] auth_strategy = keystone {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_host = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_stats_polling_interval = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backup_api_class = cinder.backup.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backup_name_template = backup-%s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backup_use_same_host = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backup_use_temp_snapshot = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] chap_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] chap_username = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_internal_tenant_project_id = 8eea8a001f9f462e9d418dcf853033f6 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_internal_tenant_user_id = 28044381c52941489932542fa873987c {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cluster = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86537]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] compression_format = gzip {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] config_dir = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] config_source = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] control_exchange = openstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] debug = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] default_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] default_group_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] default_volume_type = QuobyteHD {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] disk_geometry = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] driver_client_cert = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] driver_client_cert_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] driver_data_namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] driver_ssl_cert_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] driver_ssl_cert_verify = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] driver_use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] enable_new_services = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] enable_unsupported_driver = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] enforce_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] filter_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_api_insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_api_servers = ['http://192.168.122.39/image'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_api_ssl_compression = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_ca_certificates_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_num_retries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance_request_timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] goodness_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] graceful_shutdown_timeout = 5 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] group_api_class = cinder.group.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] host = devstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_compress_on_upload = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_conversion_address_space_limit = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_conversion_cpu_limit = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_conversion_disable = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_upload_use_cinder_backend = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_upload_use_internal_tenant = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_volume_cache_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_volume_cache_max_count = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] image_volume_cache_promote_across_pools = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] init_host_max_objects_retrieval = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] instance_format = [instance: %(uuid)s] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] iscsi_target_flags = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] iscsi_write_cache = on {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] iser_helper = tgtadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] iser_ip_address = 192.168.122.39 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] iser_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_color = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_config_append = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_dir = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_options = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_rotate_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_rotate_interval_type = days {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] log_rotation_type = none {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] max_age = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] max_logfile_count = 30 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] max_logfile_size_mb = 200 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] max_over_subscription_ratio = 20.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] message_reap_interval = 86400 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] message_ttl = 2592000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] monkey_patch = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] monkey_patch_modules = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] my_ip = 192.168.122.39 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] no_snapshot_gb_quota = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] num_iser_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] num_shell_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] num_volume_device_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] nvmeof_conn_info_version = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] nvmet_ns_id = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] nvmet_port_id = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_max_limit = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_volume_ext_list = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_volume_listen_port = 8776 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_volume_use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] osapi_volume_workers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] per_volume_size_limit = -1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] periodic_fuzzy_delay = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] periodic_interval = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] public_endpoint = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] publish_errors = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_backup_gigabytes = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_backups = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_gigabytes = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_groups = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_snapshots = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] quota_volumes = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] rate_limit_burst = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] rate_limit_except_level = CRITICAL {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] rate_limit_interval = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] reinit_driver_count = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] replication_device = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] report_discard_supported = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] report_interval = 120 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] reservation_clean_interval = 86400 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] reservation_expire = 86400 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] reserved_image_namespaces = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] reserved_percentage = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] rpc_response_timeout = 120 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] run_external_periodic_tasks = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] scst_target_driver = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] scst_target_iqn_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_down_time = 720 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] shell_completion = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] snapshot_name_template = snapshot-%s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] state_path = /opt/stack/data/cinder {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] storage_availability_zone = nova {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] storage_protocol = iSCSI {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] syslog_log_facility = LOG_USER {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] target_helper = lioadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] target_ip_address = 192.168.122.39 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] target_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] target_protocol = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] target_secondary_ip_addresses = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] trace_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] transport_url = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] until_refresh = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_chap_auth = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_default_quota_class = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_journal = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_json = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_stderr = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] use_syslog = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] verify_glance_signatures = enabled {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_api_class = cinder.volume.api.API {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_backend_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_clear = zero {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_clear_ionice = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_clear_size = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_copy_bps_limit = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_dd_blocksize = 1M {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_name_template = volume-%s {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_service_inithost_offload = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volume_usage_audit_period = month {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] zoning_mode = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86537]: INFO cinder.volume.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.remotefs [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86537) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.auth_type = password {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.auth_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.cache = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.interface = public {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_password = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcache_username = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.region_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.service_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.backend = dogpile.cache.null {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.backend_argument = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.backend_expiration_time = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.config_prefix = cache.oslo {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.debug_cache_backend = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.enable_retry_client = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.enable_socket_keepalive = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.expiration_time = 600 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_dead_retry = 300 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_sasl_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.proxies = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.redis_db = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.redis_server = localhost:6379 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.retry_attempts = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.retry_delay = 0.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.socket_keepalive_count = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.socket_keepalive_idle = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.socket_keepalive_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.socket_timeout = 1.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.tls_allowed_ciphers = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.tls_cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.tls_certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.tls_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.tls_keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cache.username = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] coordination.backend_url = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.asyncio_connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.asyncio_slave_connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.backend = sqlalchemy {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.connection_debug = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.connection_parameters = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.connection_recycle_time = 3600 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.connection_trace = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.db_inc_retry_interval = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.db_max_retries = 20 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.db_max_retry_interval = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.db_retry_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.max_overflow = 50 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.max_pool_size = 5 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.max_retries = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.pool_timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.retry_interval = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.slave_connection = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.sqlite_synchronous = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.synchronous_reader = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] database.use_db_reconnect = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.connection_string = messaging:// {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.es_doc_type = notification {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.es_scroll_size = 10000 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.es_scroll_time = 2m {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.filter_error_trace = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.hmac_keys = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.sentinel_service_name = mymaster {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.socket_timeout = 0.1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.trace_requests = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler.trace_sqlalchemy = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler_jaeger.process_tags = {} {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] profiler_otlp.service_name_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.enforce_scope = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.policy_default_rule = default {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.group = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.helper_command = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] privsep_osbrick.user = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.group = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.helper_command = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] cinder_sys_admin.user = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.auth_type = password {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.send_service_user_token = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] service_user.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.auth_type = password {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.region_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] glance.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.backend_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.chap_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.chap_username = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.disk_geometry = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.driver_client_cert = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.driver_data_namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.driver_use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.extra_capabilities = {} {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.filter_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.goodness_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.image_volume_cache_promote_across_pools = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.iscsi_target_flags = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.iser_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_host = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_login = admin {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_mount_options = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_private_key = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_share_path = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.replication_device = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.report_discard_supported = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.target_helper = tgtadm {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.target_port = 3260 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.target_protocol = iscsi {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.trace_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.use_chap_auth = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_backend_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_clear = zero {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_reports.file_event_handler = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_reports.log_dir = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.backend_host = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.chap_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.chap_username = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.disk_geometry = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.driver_client_cert = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.extra_capabilities = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.filter_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.goodness_function = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.image_volume_cache_promote_across_pools = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.iser_helper = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.iser_ip_address = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.iser_port = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_host = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_login = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_mount_options = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_password = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_private_key = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_share_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.num_shell_tries = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.replication_device = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.report_discard_supported = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.reserved_percentage = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.scst_target_driver = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.storage_protocol = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.target_helper = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.target_ip_address = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.target_port = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.target_prefix = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.target_protocol = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.trace_flags = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.use_chap_auth = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_clear = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_clear_size = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] QuobyteHD.volumes_dir = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_notifications.driver = [] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] key_manager.fixed_key = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.barbican_api_version = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.barbican_endpoint = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.barbican_endpoint_type = public {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.barbican_region_name = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.number_of_retries = 60 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.retry_delay = 1 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.send_service_user_token = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.verify_ssl = True {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican.verify_ssl_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.auth_section = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.auth_type = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.cafile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.certfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.collect_timing = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.insecure = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.keyfile = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.split_loggers = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] barbican_service_user.timeout = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.approle_role_id = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.approle_secret_id = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.kv_mountpoint = secret {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.kv_path = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.kv_version = 2 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.namespace = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.root_token_id = **** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.ssl_ca_crt_file = None {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.timeout = 60.0 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.use_ssl = False {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:20 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] ******************************************************************************** {{(pid=86320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86537) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 19:30:20 devstack cinder-volume[86537]: WARNING cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 19:30:20 devstack cinder-volume[86537]: WARNING cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Running cmd (subprocess): mount.quobyte {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:20 devstack quobyte-client[86542]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 19:30:20 devstack quobyte-client[86542]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=86537) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:20 devstack cinder-volume[86537]: INFO cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc ... Jul 08 19:30:20 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 -c /etc/quobyte/client-cinder.cfg {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:20 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 -c /etc/quobyte/client-cinder.cfg Jul 08 19:30:20 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:21 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:21 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.756s {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:21 devstack cinder-volume[86537]: INFO cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc succeeded Jul 08 19:30:21 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=86537) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:21 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.767s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:21 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:21 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:21 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:22 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.681s {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:22 devstack cinder-volume[86537]: INFO cinder.volume.driver [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Driver hasn't implemented _init_vendor_properties() Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.volume.driver [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86537) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_db.sqlalchemy.engines [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86537) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG dbcounter [-] [86537] Writer thread running {{(pid=86537) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.db.sqlalchemy.api [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Building query based on filter {{(pid=86537) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.image.image_utils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86537) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 08 19:30:22 devstack cinder-volume[86537]: INFO cinder.keymgr.migration [None req-f3b1133c-f995-400d-8bec-371a7ee03fa9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=86537) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=86537) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:22 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:22 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:22 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.618s {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Notifying Schedulers of capabilities ... {{(pid=86537) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:30:22 devstack cinder-volume[86537]: INFO cinder.volume.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Driver initialization completed successfully. Jul 08 19:30:22 devstack cinder-volume[86537]: INFO cinder.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Initiating service 3 cleanup Jul 08 19:30:22 devstack cinder-volume[86537]: INFO cinder.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Service 3 cleanup completed. Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.service [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Creating RPC server for service cinder-volume {{(pid=86537) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.service [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86537) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 19:30:22 devstack cinder-volume[86537]: INFO cinder.volume.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=86537) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=86537) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:22 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:22 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:22 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:23 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:23 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.751s {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:23 devstack cinder-volume[86537]: INFO cinder.volume.manager [None req-c7197da5-1aed-487e-b162-1e4603bfb6ac None None] Driver post RPC initialization completed successfully. Jul 08 19:30:27 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:27 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:27 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=86537) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:27 devstack cinder-volume[86537]: DEBUG cinder.volume.drivers.quobyte [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=86537) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:27 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86537) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:27 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:27 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:27 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:28 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:28 devstack cinder-volume[86537]: DEBUG oslo_concurrency.processutils [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.601s {{(pid=86537) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:28 devstack cinder-volume[86537]: DEBUG cinder.manager [None req-0c87bd04-48ed-47b6-bc3f-99c9794c402a None None] Notifying Schedulers of capabilities ... {{(pid=86537) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:30:30 devstack cinder-volume[86320]: DEBUG dbcounter [-] [86320] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:30 devstack cinder-volume[86320]: INFO oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Caught SIGTERM, stopping children Jul 08 19:30:30 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Acquiring lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:30:30 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Acquired lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:30:30 devstack cinder-volume[86320]: DEBUG oslo_concurrency.lockutils [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Releasing lock "singleton_lock" {{(pid=86320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:30:30 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Stop services. {{(pid=86320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 19:30:30 devstack cinder-volume[86320]: DEBUG oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Killing children. {{(pid=86320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 19:30:30 devstack cinder-volume[86320]: INFO oslo_service.backend._eventlet.service [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Waiting on 1 children to exit Jul 08 19:30:33 devstack cinder-volume[86537]: DEBUG dbcounter [-] [86537] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86537) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:33 devstack cinder-volume[86537]: DEBUG dbcounter [-] [86537] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86537) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:35 devstack cinder-volume[86537]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 08 19:30:35 devstack cinder-volume[87003]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 19:30:35 devstack cinder-volume[87003]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 19:30:35 devstack cinder-volume[87003]: we strongly recommend against using it for new projects. Jul 08 19:30:35 devstack cinder-volume[87003]: If you are already using Eventlet, we recommend migrating to a different Jul 08 19:30:35 devstack cinder-volume[87003]: framework. For more detail see Jul 08 19:30:35 devstack cinder-volume[87003]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 19:30:35 devstack cinder-volume[87003]: import eventlet # noqa Jul 08 19:30:36 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Acquiring lock "singleton_lock" {{(pid=86537) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:30:36 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Acquired lock "singleton_lock" {{(pid=86537) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:30:36 devstack cinder-volume[86537]: DEBUG oslo_concurrency.lockutils [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Releasing lock "singleton_lock" {{(pid=86537) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:30:36 devstack cinder-volume[86537]: WARNING amqp [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 19:30:36 devstack cinder-volume[86537]: WARNING amqp [None req-fc335d72-623e-4893-8f89-93b1627f8dd5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 19:30:38 devstack cinder-volume[87003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 19:30:38 devstack cinder-volume[87003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 19:30:38 devstack cinder-volume[87003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87003) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 19:30:38 devstack cinder-volume[87003]: INFO dbcounter [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Registered counter for database cinder Jul 08 19:30:38 devstack cinder-volume[87003]: DEBUG oslo_db.sqlalchemy.engines [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG dbcounter [-] [87003] Writer thread running {{(pid=87003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 19:30:39 devstack cinder-volume[87003]: INFO cinder.rpc [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 19:30:39 devstack cinder-volume[87003]: INFO cinder.rpc [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_db.sqlalchemy.engines [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:39 devstack cinder-volume[87003]: INFO cinder.volume.manager [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Determined volume DB was empty at startup. Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG cinder.volume.manager [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87003) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 19:30:39 devstack cinder-volume[87003]: WARNING stevedore.named [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 19:30:39 devstack cinder-volume[87003]: WARNING castellan.key_manager [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:30:39 devstack cinder-volume[87003]: WARNING cinder.keymgr.conf_key_mgr [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 19:30:39 devstack cinder-volume[87003]: INFO cinder.volume.manager [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_db.sqlalchemy.engines [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87003) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:39 devstack cinder-volume[87003]: INFO oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Starting 1 workers Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Started child 87172 {{(pid=87003) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Full set of CONF: {{(pid=87003) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] ******************************************************************************** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] Configuration options gathered from: {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] ================================================================================ {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 19:30:39 devstack cinder-volume[87172]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] allow_availability_zone_fallback = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] allow_compression_on_image_upload = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] allowed_direct_url_schemes = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] api_rate_limit = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] auth_strategy = keystone {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_availability_zone = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_host = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_stats_polling_interval = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backup_api_class = cinder.backup.api.API {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backup_name_template = backup-%s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backup_use_same_host = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backup_use_temp_snapshot = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] chap_password = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] chap_username = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_internal_tenant_project_id = 8eea8a001f9f462e9d418dcf853033f6 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_internal_tenant_user_id = 28044381c52941489932542fa873987c {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cluster = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] compression_format = gzip {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] compute_api_class = cinder.compute.nova.API {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] config_dir = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] config_source = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] control_exchange = openstack {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] debug = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] default_availability_zone = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] default_group_type = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] default_volume_type = QuobyteHD {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] disk_geometry = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] driver_client_cert = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] driver_client_cert_key = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] driver_data_namespace = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] driver_ssl_cert_path = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] driver_ssl_cert_verify = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] driver_use_ssl = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] enable_new_services = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] enable_unsupported_driver = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] enabled_backends = ['QuobyteHD'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] enforce_multipath_for_image_xfer = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] filter_function = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_api_insecure = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_api_servers = ['http://192.168.122.39/image'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_api_ssl_compression = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_ca_certificates_file = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_catalog_info = image:glance:publicURL {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_num_retries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance_request_timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] goodness_function = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] graceful_shutdown_timeout = 5 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] group_api_class = cinder.group.api.API {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] host = devstack {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_compress_on_upload = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_conversion_address_space_limit = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_conversion_cpu_limit = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_conversion_disable = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_upload_use_cinder_backend = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_upload_use_internal_tenant = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_volume_cache_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_volume_cache_max_count = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_volume_cache_max_size_gb = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] image_volume_cache_promote_across_pools = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] init_host_max_objects_retrieval = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] instance_format = [instance: %(uuid)s] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] iscsi_target_flags = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] iscsi_write_cache = on {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] iser_helper = tgtadm {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] iser_ip_address = 192.168.122.39 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] iser_port = 3260 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_color = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_config_append = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_dir = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_file = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_options = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_rotate_interval = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87172) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_rotate_interval_type = days {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] log_rotation_type = none {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] max_age = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] max_logfile_count = 30 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] max_logfile_size_mb = 200 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] max_over_subscription_ratio = 20.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] message_reap_interval = 86400 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] message_ttl = 2592000 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] migration_create_volume_timeout_secs = 300 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] monkey_patch = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] monkey_patch_modules = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] my_ip = 192.168.122.39 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] no_snapshot_gb_quota = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] num_iser_scan_tries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] num_shell_tries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] num_volume_device_scan_tries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] nvmeof_conn_info_version = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] nvmet_ns_id = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] nvmet_port_id = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_max_limit = 1000 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_volume_ext_list = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_volume_listen = 0.0.0.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_volume_listen_port = 8776 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_volume_use_ssl = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] osapi_volume_workers = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] per_volume_size_limit = -1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] periodic_fuzzy_delay = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] periodic_interval = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] project_id_regex = [0-9a-f\-]+ {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] public_endpoint = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] publish_errors = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_backup_gigabytes = 1000 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_backups = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_gigabytes = 1000 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_groups = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_snapshots = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] quota_volumes = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] rate_limit_burst = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] rate_limit_except_level = CRITICAL {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] rate_limit_interval = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] reinit_driver_count = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] replication_device = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] report_discard_supported = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] report_interval = 120 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] reservation_clean_interval = 86400 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] reservation_expire = 86400 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] reserved_image_namespaces = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] reserved_percentage = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] rpc_response_timeout = 120 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] run_external_periodic_tasks = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] scst_target_driver = iscsi {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] scst_target_iqn_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_down_time = 720 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] shell_completion = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] snapshot_name_template = snapshot-%s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] split_loggers = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] state_path = /opt/stack/data/cinder {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] storage_availability_zone = nova {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] storage_protocol = iSCSI {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] syslog_log_facility = LOG_USER {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] target_helper = lioadm {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] target_ip_address = 192.168.122.39 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] target_port = 3260 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] target_protocol = iscsi {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] target_secondary_ip_addresses = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] trace_flags = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] transfer_api_class = cinder.transfer.api.API {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] transport_url = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] until_refresh = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_chap_auth = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_default_quota_class = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_journal = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_json = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_multipath_for_image_xfer = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_stderr = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] use_syslog = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] verify_glance_signatures = enabled {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_api_class = cinder.volume.api.API {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_backend_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_clear = zero {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_clear_ionice = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_clear_size = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_copy_bps_limit = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_dd_blocksize = 1M {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_name_template = volume-%s {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_service_inithost_offload = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volume_usage_audit_period = month {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] zoning_mode = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_concurrency.disable_process_locking = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.auth_section = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.auth_type = password {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.auth_version = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.cache = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.delay_auth_decision = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.http_connect_timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.include_service_catalog = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.insecure = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.interface = public {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_password = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcache_username = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.region_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.service_token_roles_required = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.service_type = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.token_cache_time = 300 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.backend = dogpile.cache.null {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.backend_argument = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.backend_expiration_time = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.config_prefix = cache.oslo {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.debug_cache_backend = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.enable_retry_client = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.enable_socket_keepalive = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.expiration_time = 600 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.hashclient_retry_attempts = 2 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87172) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 19:30:39 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_dead_retry = 300 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_pool_maxsize = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_sasl_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.password = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.proxies = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.redis_db = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.redis_sentinel_service_name = mymaster {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.redis_server = localhost:6379 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.retry_attempts = 2 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.retry_delay = 0.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.socket_keepalive_count = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Running cmd (subprocess): mount.quobyte {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.socket_keepalive_idle = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.socket_keepalive_interval = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.socket_timeout = 1.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.tls_allowed_ciphers = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.tls_cafile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.tls_certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.tls_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.tls_keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cache.username = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] coordination.backend_url = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.asyncio_connection = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.asyncio_slave_connection = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.backend = sqlalchemy {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.connection = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.connection_debug = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.connection_parameters = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.connection_recycle_time = 3600 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.connection_trace = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.db_inc_retry_interval = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.db_max_retries = 20 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.db_max_retry_interval = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.db_retry_interval = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.max_overflow = 50 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.max_pool_size = 5 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.max_retries = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.mysql_wsrep_sync_wait = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.pool_timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.retry_interval = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.slave_connection = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.sqlite_synchronous = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.synchronous_reader = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] database.use_db_reconnect = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.connection_string = messaging:// {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.es_doc_type = notification {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.es_scroll_size = 10000 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.es_scroll_time = 2m {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.filter_error_trace = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.hmac_keys = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.sentinel_service_name = mymaster {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.socket_timeout = 0.1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.trace_requests = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler.trace_sqlalchemy = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler_jaeger.process_tags = {} {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler_jaeger.service_name_prefix = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] profiler_otlp.service_name_prefix = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.enforce_new_defaults = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.enforce_scope = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.policy_default_rule = default {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.policy_file = policy.yaml {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_policy.remote_timeout = 60.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.group = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.helper_command = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] privsep_osbrick.user = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.group = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.helper_command = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] cinder_sys_admin.user = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.auth_section = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.auth_type = password {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.cafile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.collect_timing = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.insecure = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.send_service_user_token = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.split_loggers = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] service_user.timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.auth_section = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.auth_type = password {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.collect_timing = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.insecure = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.region_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.split_loggers = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] glance.timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.backend_availability_zone = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.chap_password = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.chap_username = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.disk_geometry = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.driver_client_cert = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.driver_client_cert_key = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.driver_data_namespace = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.driver_use_ssl = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.enable_unsupported_driver = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.extra_capabilities = {} {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.filter_function = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.goodness_function = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.image_volume_cache_promote_across_pools = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.iscsi_target_flags = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.iscsi_write_cache = on {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.iser_helper = tgtadm {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.iser_port = 3260 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_host = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_login = admin {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_mount_options = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_password = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_private_key = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_share_path = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_ssh_port = 22 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.num_shell_tries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.nvmet_port_id = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_client_cfg = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack quobyte-client[87174]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.quobyte_volume_url = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.replication_device = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack quobyte-client[87174]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.report_discard_supported = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.reserved_percentage = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.scst_target_driver = iscsi {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.scst_target_iqn_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.storage_protocol = iSCSI {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.target_helper = tgtadm {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.target_port = 3260 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.target_protocol = iscsi {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.trace_flags = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.unique_fqdn_network = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.use_chap_auth = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_backend_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_clear = zero {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_clear_ionice = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_clear_size = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_reports.file_event_handler = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_reports.log_dir = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.backend_availability_zone = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.backend_host = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.chap_password = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.chap_username = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.chiscsi_conf = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.disk_geometry = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.driver_client_cert = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.driver_client_cert_key = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.driver_data_namespace = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.driver_use_ssl = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.extra_capabilities = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.filter_function = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.goodness_function = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.image_volume_cache_promote_across_pools = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.iscsi_target_flags = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.iscsi_write_cache = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.iser_helper = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.iser_ip_address = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.iser_port = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.iser_target_prefix = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_host = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_login = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_mount_options = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_password = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_private_key = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_share_path = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_ssh_port = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.num_shell_tries = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nvmet_ns_id = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.nvmet_port_id = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.replication_device = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.report_discard_supported = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.reserved_percentage = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.scst_target_driver = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.storage_protocol = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.target_helper = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.target_ip_address = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.target_port = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.target_prefix = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.target_protocol = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.trace_flags = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.unique_fqdn_network = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.use_chap_auth = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_clear = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_clear_ionice = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_clear_size = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] QuobyteHD.volumes_dir = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.ssl_version = {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_notifications.driver = [] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_notifications.retry = -1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] oslo_messaging_notifications.transport_url = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] key_manager.fixed_key = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.barbican_api_version = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.barbican_endpoint = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.barbican_endpoint_type = public {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.barbican_region_name = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.cafile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.collect_timing = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.insecure = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.number_of_retries = 60 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.retry_delay = 1 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.send_service_user_token = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.split_loggers = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.verify_ssl = True {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican.verify_ssl_path = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.auth_section = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.auth_type = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.cafile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.certfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.collect_timing = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.insecure = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.keyfile = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.split_loggers = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] barbican_service_user.timeout = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.approle_role_id = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.approle_secret_id = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.kv_mountpoint = secret {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.kv_path = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.kv_version = 2 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.namespace = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.root_token_id = **** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.ssl_ca_crt_file = None {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.timeout = 60.0 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.use_ssl = False {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 19:30:39 devstack cinder-volume[87003]: DEBUG oslo_service.backend._eventlet.service [None req-88e2b325-d0cf-42f3-8a72-336361d3aa6a None None] ******************************************************************************** {{(pid=87003) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 19:30:40 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.584s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:40 devstack cinder-volume[87172]: INFO cinder.volume.driver [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Driver hasn't implemented _init_vendor_properties() Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.volume.driver [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87172) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:885}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_db.sqlalchemy.engines [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87172) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writer thread running {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.db.sqlalchemy.api [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Building query based on filter {{(pid=87172) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87172) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:40 devstack cinder-volume[87172]: INFO cinder.keymgr.migration [None req-21f67624-9310-44cc-864f-467287be7805 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 19:30:40 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:40 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:40 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.605s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:30:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Driver initialization completed successfully. Jul 08 19:30:40 devstack cinder-volume[87172]: INFO cinder.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Initiating service 3 cleanup Jul 08 19:30:40 devstack cinder-volume[87172]: INFO cinder.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Service 3 cleanup completed. Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.service [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Creating RPC server for service cinder-volume {{(pid=87172) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.service [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87172) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 19:30:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:30:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:30:40 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:30:40 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:30:41 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Jul 08 19:30:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.635s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:30:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-771b66b4-2d24-42f1-9799-5cfcf2fba2ee None None] Driver post RPC initialization completed successfully. Jul 08 19:30:49 devstack cinder-volume[87003]: DEBUG dbcounter [-] [87003] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87003) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:50 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:30:51 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=4 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:31:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:31:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 6 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:31:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Flow 'volume_create_manager' (8d291603-100a-465d-9c16-68e126676a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0286b2a0-c93a-40d5-a1d7-10ef03347bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0286b2a0-c93a-40d5-a1d7-10ef03347bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1007782329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2372666c-8ad0-4343-8357-dce14e863ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad39357edccb411aa6c2cec6913ac5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:31:38Z,use_quota=True,user_id='5eac12b8400748ff87ee0a448f4947ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c0c2a8-988a-49f1-b156-362dc1610d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c0c2a8-988a-49f1-b156-362dc1610d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670208c3-6973-4849-b3ac-1eb76fc1586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670208c3-6973-4849-b3ac-1eb76fc1586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2372666c-8ad0-4343-8357-dce14e863ace', 'volume_name': 'volume-2372666c-8ad0-4343-8357-dce14e863ace', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e87758-7e6b-42d1-b9f5-16257c431ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e87758-7e6b-42d1-b9f5-16257c431ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38578945-6971-407c-8da0-4b1751ba06da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:38 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Volume 2372666c-8ad0-4343-8357-dce14e863ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2372666c-8ad0-4343-8357-dce14e863ace', 'volume_size': 1} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1007782329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2372666c-8ad0-4343-8357-dce14e863ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad39357edccb411aa6c2cec6913ac5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:31:38Z,use_quota=True,user_id='5eac12b8400748ff87ee0a448f4947ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Creating volume 2372666c-8ad0-4343-8357-dce14e863ace {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:31:38 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:31:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:31:38 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace 1073741824 Jul 08 19:31:38 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:31:39 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Jul 08 19:31:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace 1073741824" returned: 0 in 1.082s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:31:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:31:39 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace Jul 08 19:31:39 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:31:40 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace" returned: 0 in 1.035s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38578945-6971-407c-8da0-4b1751ba06da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2372666c-8ad0-4343-8357-dce14e863ace', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dc8883-df66-49d9-aca4-bba43834b781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:40 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Volume volume-2372666c-8ad0-4343-8357-dce14e863ace (2372666c-8ad0-4343-8357-dce14e863ace): created successfully Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dc8883-df66-49d9-aca4-bba43834b781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Flow 'volume_create_manager' (8d291603-100a-465d-9c16-68e126676a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:31:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c019139a-64e2-4df4-b464-bbae779c9f16 tempest-TaggedAttachmentsTest-2135435323 None] Created volume successfully. Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Flow 'volume_create_manager' (c9d34118-3568-4dcb-8a92-f36b8b87cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f72f9b-c7a1-45bf-a71a-7611e756b15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f72f9b-c7a1-45bf-a71a-7611e756b15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1537548081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14286f6c-b17a-4dcd-ac6a-329133a71944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c64519c7db64005807c273fa284269b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:31:46Z,use_quota=True,user_id='a31120fca4224737aafcb12ce494bd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f42f40d-7401-4a58-a216-5e6d05338b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f42f40d-7401-4a58-a216-5e6d05338b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230d043f-b75e-4b54-9786-7b0e80da7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230d043f-b75e-4b54-9786-7b0e80da7c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14286f6c-b17a-4dcd-ac6a-329133a71944', 'volume_name': 'volume-14286f6c-b17a-4dcd-ac6a-329133a71944', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972825a5-d060-4baa-87eb-191c181d079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972825a5-d060-4baa-87eb-191c181d079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c744f66-4203-424e-9fbd-62b7612bc8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Volume 14286f6c-b17a-4dcd-ac6a-329133a71944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14286f6c-b17a-4dcd-ac6a-329133a71944', 'volume_size': 1} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1537548081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14286f6c-b17a-4dcd-ac6a-329133a71944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c64519c7db64005807c273fa284269b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:31:46Z,use_quota=True,user_id='a31120fca4224737aafcb12ce494bd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Creating volume 14286f6c-b17a-4dcd-ac6a-329133a71944 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:31:46 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:31:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:31:46 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 1073741824 Jul 08 19:31:46 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:31:48 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Jul 08 19:31:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 1073741824" returned: 0 in 1.890s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:31:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:31:48 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 Jul 08 19:31:48 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:31:49 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944" returned: 0 in 1.308s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] <== create_volume: return (3272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.276s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c744f66-4203-424e-9fbd-62b7612bc8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14286f6c-b17a-4dcd-ac6a-329133a71944', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604cfd72-c539-463d-ae8f-e4f0b98b7c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:31:49 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Volume volume-14286f6c-b17a-4dcd-ac6a-329133a71944 (14286f6c-b17a-4dcd-ac6a-329133a71944): created successfully Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604cfd72-c539-463d-ae8f-e4f0b98b7c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:31:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Flow 'volume_create_manager' (c9d34118-3568-4dcb-8a92-f36b8b87cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:31:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f94d2bac-1b77-4604-aa9e-415a23173612 tempest-DeleteServersTestJSON-1137143853 None] Created volume successfully. Jul 08 19:31:58 devstack cinder-volume[87172]: WARNING py.warnings [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 08 19:31:58 devstack cinder-volume[87172]: .first() Jul 08 19:31:58 devstack cinder-volume[87172]: Jul 08 19:31:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:31:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:31:58 devstack cinder-volume[87172]: INFO oslo.privsep.daemon [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6avo43zn/privsep.sock'] Jul 08 19:31:58 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6avo43zn/privsep.sock Jul 08 19:31:58 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 19:31:59 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 19:32:00 devstack cinder-volume[87172]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 19:32:01 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:01 devstack cinder-volume[87172]: INFO oslo.privsep.daemon [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Spawned new privsep daemon via rootwrap Jul 08 19:32:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Accepted privsep connection to /tmp/tmp6avo43zn/privsep.sock {{(pid=87172) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 19:32:01 devstack cinder-volume[87172]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 19:32:01 devstack cinder-volume[87172]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 19:32:01 devstack cinder-volume[87172]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 19:32:01 devstack cinder-volume[87172]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88217 Jul 08 19:32:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab608e77-01bf-452a-a1fa-c271236df22a]: (2,) {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc9737-695a-4772-814b-0eaa478a6b41]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:01 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 Jul 08 19:32:01 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:02 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944" returned: 0 in 1.077s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.474s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-14286f6c-b17a-4dcd-ac6a-329133a71944', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed322566-0fb6-4a55-beb8-ed71c8f78c4f', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:32:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-5bd29df7-3bdb-4fa8-aac3-fc57bcb33740 req-dd27d434-dcf4-43bd-b9fe-2c4c384a1613 tempest-DeleteServersTestJSON-1137143853 None] attachment_update completed successfully. Jul 08 19:32:12 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:32:12 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1,cinder:SELECT=9 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:32:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-09903af6-d4c5-4bc1-ac08-b436d17aa67a req-330ace8d-21a3-4339-b5c8-4773147244aa tempest-DeleteServersTestJSON-1137143853 None] Terminate volume connection completed successfully. Jul 08 19:32:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-09903af6-d4c5-4bc1-ac08-b436d17aa67a req-330ace8d-21a3-4339-b5c8-4773147244aa tempest-DeleteServersTestJSON-1137143853 None] Deleting attachment ed322566-0fb6-4a55-beb8-ed71c8f78c4f. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:32:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Acquiring lock "cinder-14286f6c-b17a-4dcd-ac6a-329133a71944-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Lock "cinder-14286f6c-b17a-4dcd-ac6a-329133a71944-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Acquiring lock "cinder-quobyte-14286f6c-b17a-4dcd-ac6a-329133a71944" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Lock "cinder-quobyte-14286f6c-b17a-4dcd-ac6a-329133a71944" acquired by "delete_volume" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea395ee2-c2d7-42f9-8c6d-1d822dbaeb4f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:17 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 Jul 08 19:32:17 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:18 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944" returned: 0 in 0.749s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:18 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944 Jul 08 19:32:18 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:18 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-14286f6c-b17a-4dcd-ac6a-329133a71944" returned: 0 in 0.725s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Lock "cinder-quobyte-14286f6c-b17a-4dcd-ac6a-329133a71944" released by "delete_volume" :: held 1.529s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:32:18 devstack cinder-volume[87172]: WARNING cinder.quota [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:32:18 devstack cinder-volume[87172]: WARNING cinder.quota [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Created reservations ['a292d843-cbe1-4024-904e-56c535c8de5e', '9a28a038-9966-44bc-812d-a959527cd4fd', '63f9f13f-4fbe-402c-869b-2cd4bbe78857', 'f9a30152-39a7-4340-ab4c-43c2a01b9cec'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:19 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:32:19 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:20 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.927s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:20 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:32:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Deleted volume successfully. Jul 08 19:32:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-73c46c10-aa3c-4617-a37b-14d2ee857c4a tempest-DeleteServersTestJSON-1137143853 None] Lock "cinder-14286f6c-b17a-4dcd-ac6a-329133a71944-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Flow 'volume_create_manager' (50d44cfe-4777-456c-8f7f-0e904303f2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e195cdc5-e643-400c-8a9a-4209ae71a8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e195cdc5-e643-400c-8a9a-4209ae71a8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2125020623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee84073e-e91a-4973-9331-098b9d769744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2b817095d4d47bb7c662c059d2b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:32:24Z,use_quota=True,user_id='6e4feb16f37e46539da2755a5643747a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7beb70-cdd7-4011-abcc-a4cf61432b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7beb70-cdd7-4011-abcc-a4cf61432b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6d98d9-a426-453a-ac09-e6065eae6ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6d98d9-a426-453a-ac09-e6065eae6ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee84073e-e91a-4973-9331-098b9d769744', 'volume_name': 'volume-ee84073e-e91a-4973-9331-098b9d769744', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739f5fcb-fbd8-4b7c-9592-18f822d55f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739f5fcb-fbd8-4b7c-9592-18f822d55f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae45e97-a73c-4970-a555-a5bf118fcbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Volume ee84073e-e91a-4973-9331-098b9d769744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee84073e-e91a-4973-9331-098b9d769744', 'volume_size': 1} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2125020623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee84073e-e91a-4973-9331-098b9d769744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22b2b817095d4d47bb7c662c059d2b06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:32:24Z,use_quota=True,user_id='6e4feb16f37e46539da2755a5643747a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Creating volume ee84073e-e91a-4973-9331-098b9d769744 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:32:24 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:32:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:24 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 1073741824 Jul 08 19:32:24 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:25 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 1073741824" returned: 0 in 0.989s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:25 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 Jul 08 19:32:25 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:26 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744" returned: 0 in 1.038s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae45e97-a73c-4970-a555-a5bf118fcbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee84073e-e91a-4973-9331-098b9d769744', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d6854-363f-4889-8e7c-6e2fd9d4f10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Volume volume-ee84073e-e91a-4973-9331-098b9d769744 (ee84073e-e91a-4973-9331-098b9d769744): created successfully Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d6854-363f-4889-8e7c-6e2fd9d4f10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Flow 'volume_create_manager' (50d44cfe-4777-456c-8f7f-0e904303f2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:32:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-80952964-df3d-4e89-afad-f146bdc64f40 tempest-ServerActionsTestOtherA-618711776 None] Created volume successfully. Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Flow 'volume_create_manager' (02dbd2f9-43d0-4392-b5ec-bfef6aca8769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c93d67-f995-4475-8c40-bed99ba4c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c93d67-f995-4475-8c40-bed99ba4c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2068890299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff8c68d-9ecd-4e5c-ab48-47c143ed797b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03225bae9c8b4108a1b907257027b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:32:29Z,use_quota=True,user_id='a577f54456f5424b94746335a1c70acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ae000b-44b8-44b0-ae9f-cff5bfa38737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ae000b-44b8-44b0-ae9f-cff5bfa38737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4c1b8e-bfa7-4768-9cad-bd822e90b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4c1b8e-bfa7-4768-9cad-bd822e90b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff8c68d-9ecd-4e5c-ab48-47c143ed797b', 'volume_name': 'volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ab2aba-21a7-4e56-ab5a-c53cb5731a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ab2aba-21a7-4e56-ab5a-c53cb5731a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87307298-225c-4362-8158-972fd57321b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:28 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Volume 9ff8c68d-9ecd-4e5c-ab48-47c143ed797b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b', 'volume_size': 1} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2068890299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff8c68d-9ecd-4e5c-ab48-47c143ed797b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03225bae9c8b4108a1b907257027b3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:32:29Z,use_quota=True,user_id='a577f54456f5424b94746335a1c70acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Creating volume 9ff8c68d-9ecd-4e5c-ab48-47c143ed797b {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:32:29 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:29 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b 1073741824 Jul 08 19:32:29 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:29 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b 1073741824" returned: 0 in 0.984s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:30 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b Jul 08 19:32:30 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:30 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b" returned: 0 in 0.677s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87307298-225c-4362-8158-972fd57321b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c082b50-3c02-4d7e-814c-1b886c1686d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:30 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Volume volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b (9ff8c68d-9ecd-4e5c-ab48-47c143ed797b): created successfully Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c082b50-3c02-4d7e-814c-1b886c1686d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Flow 'volume_create_manager' (02dbd2f9-43d0-4392-b5ec-bfef6aca8769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:32:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-9cfdce0f-2f58-42ee-bdf9-f6ea751bdd10 req-4f4f59c5-24b9-4ad0-afe8-6c0b2d51ae55 tempest-VolumesGetTestJSON-29744531 None] Created volume successfully. Jul 08 19:32:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Acquiring lock "cinder-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Lock "cinder-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Acquiring lock "cinder-quobyte-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Lock "cinder-quobyte-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a90ff26-de99-422c-b724-340948d2bae2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:31 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b Jul 08 19:32:31 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:32 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b" returned: 0 in 0.776s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:32 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b Jul 08 19:32:32 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:33 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b" returned: 0 in 0.779s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Lock "cinder-quobyte-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b" released by "delete_volume" :: held 1.650s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG cinder.quota [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Created reservations ['d6cf9b14-f84b-476b-a224-69643762b273', '65afc46d-4363-4c9e-89ab-360f8daef50a', 'd3c6da28-a930-4c79-8186-a01bd8a6193d', 'c1029150-bc18-4441-8c15-96d8a96c78db'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:33 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:32:33 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:34 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.890s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG cinder.manager [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:32:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Deleted volume successfully. Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-99d9a53d-38a8-4aa1-8a82-3a4cbfb43913 req-35ffa3dc-908c-4f58-b60b-31643be4ced2 tempest-VolumesGetTestJSON-29744531 None] Lock "cinder-9ff8c68d-9ecd-4e5c-ab48-47c143ed797b-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:34 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:32:34 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:35 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.926s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:32:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:32:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:32:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:32:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d2725bc2-9787-489e-a533-98f40e0c92b7 tempest-GroupSnapshotsV319Test-2137229546 None] Group tempest-GroupSnapshotsV319Test-Group-2096947937: creating Jul 08 19:32:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d2725bc2-9787-489e-a533-98f40e0c92b7 tempest-GroupSnapshotsV319Test-2137229546 None] Group tempest-GroupSnapshotsV319Test-Group-2096947937: created successfully Jul 08 19:32:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d2725bc2-9787-489e-a533-98f40e0c92b7 tempest-GroupSnapshotsV319Test-2137229546 None] Create group completed successfully. Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Flow 'volume_create_manager' (0036d4ba-0faa-4b99-89ad-05673ea9d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aa170e-10c2-405e-b808-2ddedbbe38bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12aa170e-10c2-405e-b808-2ddedbbe38bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-466164336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27db9d4d-418d-4984-92dd-f7d813856ed7,host='devstack@QuobyteHD#QuobyteHD',id=e2789178-c627-4c99-a413-e948315ff88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8a99e3df8443b6bc4146fc613659b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:32:41Z,use_quota=True,user_id='a693eb49a8cc46849b9ce8fc27afce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f43f9b2-b752-4f78-b806-701cfeff0948),volume_type_id=5f43f9b2-b752-4f78-b806-701cfeff0948)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90040c2-b65e-4f3b-8e1d-a19567067070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90040c2-b65e-4f3b-8e1d-a19567067070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415ca4da-bb89-4f9b-9c03-30ad2fa45ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415ca4da-bb89-4f9b-9c03-30ad2fa45ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2789178-c627-4c99-a413-e948315ff88a', 'volume_name': 'volume-e2789178-c627-4c99-a413-e948315ff88a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23134ef3-84cc-423e-aa11-bf0c085526d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23134ef3-84cc-423e-aa11-bf0c085526d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1db730e-e3f2-4e4c-82ad-c67d9f867558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Volume e2789178-c627-4c99-a413-e948315ff88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2789178-c627-4c99-a413-e948315ff88a', 'volume_size': 1} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27db9d4d-418d-4984-92dd-f7d813856ed7,created_at=2026-07-08T17:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-466164336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27db9d4d-418d-4984-92dd-f7d813856ed7,host='devstack@QuobyteHD#QuobyteHD',id=e2789178-c627-4c99-a413-e948315ff88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8a99e3df8443b6bc4146fc613659b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:32:41Z,use_quota=True,user_id='a693eb49a8cc46849b9ce8fc27afce21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f43f9b2-b752-4f78-b806-701cfeff0948),volume_type_id=5f43f9b2-b752-4f78-b806-701cfeff0948)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Creating volume e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:32:41 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:32:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:41 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a 1073741824 Jul 08 19:32:41 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:42 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a 1073741824" returned: 0 in 1.328s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:43 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a Jul 08 19:32:43 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:44 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a" returned: 0 in 1.305s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] <== create_volume: return (2699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.701s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1db730e-e3f2-4e4c-82ad-c67d9f867558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2789178-c627-4c99-a413-e948315ff88a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a436783e-5bea-4171-b56f-dce001ed5a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:32:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Volume volume-e2789178-c627-4c99-a413-e948315ff88a (e2789178-c627-4c99-a413-e948315ff88a): created successfully Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a436783e-5bea-4171-b56f-dce001ed5a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:32:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Flow 'volume_create_manager' (0036d4ba-0faa-4b99-89ad-05673ea9d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:32:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f1f8d445-4f97-4e36-b36e-6ed0a75f441c tempest-GroupSnapshotsV319Test-2137229546 None] Created volume successfully. Jul 08 19:32:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] GroupSnapshot 5f04a5af-0527-4a3f-8a9f-7781ac93e499: creating. Jul 08 19:32:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Group snapshot 5f04a5af-0527-4a3f-8a9f-7781ac93e499: creating. {{(pid=87172) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}} Jul 08 19:32:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Creating offline snapshot 14ce97af-2291-407f-b77f-dc0f80f2a694 of volume e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:32:46 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d684cca-8582-43c2-8e27-4537cb1c56f2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:46 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a Jul 08 19:32:46 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:47 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a" returned: 0 in 1.248s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:47 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 1G Jul 08 19:32:47 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:48 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 1G" returned: 0 in 0.956s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2789178-c627-4c99-a413-e948315ff88a -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:48 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2789178-c627-4c99-a413-e948315ff88a -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 Jul 08 19:32:48 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:49 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2789178-c627-4c99-a413-e948315ff88a -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694" returned: 0 in 1.002s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:49 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:32:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:49 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 Jul 08 19:32:49 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:50 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694" returned: 0 in 0.870s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:50 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info Jul 08 19:32:50 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:51 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info" returned: 0 in 0.733s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:51 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:32:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:51 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info Jul 08 19:32:51 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:51 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.info" returned: 0 in 0.734s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.738s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:52 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-db1137f9-c845-4da2-a68e-03f41a0474c4 tempest-GroupSnapshotsV319Test-2137229546 None] group_snapshot 5f04a5af-0527-4a3f-8a9f-7781ac93e499: created successfully Jul 08 19:32:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:32:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:32:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f9f4b2-ea6e-4fa0-af47-fb0e5d06c920]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:53 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace Jul 08 19:32:53 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] group_snapshot 5f04a5af-0527-4a3f-8a9f-7781ac93e499: deleting Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] group_snapshot 5f04a5af-0527-4a3f-8a9f-7781ac93e499: deleting {{(pid=87172) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "cinder-quobyte-e2789178-c627-4c99-a413-e948315ff88a" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "cinder-quobyte-e2789178-c627-4c99-a413-e948315ff88a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "cinder-quobyte-14ce97af-2291-407f-b77f-dc0f80f2a694" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "cinder-quobyte-14ce97af-2291-407f-b77f-dc0f80f2a694" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Deleting offline snapshot 14ce97af-2291-407f-b77f-dc0f80f2a694 of volume e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] snapshot_file for this snap is: volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:32:54 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2869fe87-856a-4043-8195-63b92fce2ed6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace" returned: 0 in 1.263s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.302s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:32:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-2372666c-8ad0-4343-8357-dce14e863ace', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70fa9cf5-8666-4661-9cef-8321e223d583', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:32:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-06e8c06c-443a-483e-a51a-26e3f70cc696 req-e46d3daf-ce7f-4951-8e99-bc9cd7a6c35c tempest-TaggedAttachmentsTest-2135435323 None] attachment_update completed successfully. Jul 08 19:32:54 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 Jul 08 19:32:54 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:55 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694" returned: 0 in 1.114s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2789178-c627-4c99-a413-e948315ff88a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:32:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e290ad-c32c-4d0c-aca3-1d140307fb9a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:55 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a Jul 08 19:32:55 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:56 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a" returned: 0 in 1.138s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:56 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 Jul 08 19:32:56 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:57 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694" returned: 0 in 0.798s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:57 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694 Jul 08 19:32:57 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:32:58 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Jul 08 19:32:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a.14ce97af-2291-407f-b77f-dc0f80f2a694" returned: 0 in 0.736s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:32:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "cinder-quobyte-14ce97af-2291-407f-b77f-dc0f80f2a694" released by "_delete_snapshot" :: held 3.960s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:32:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "cinder-quobyte-e2789178-c627-4c99-a413-e948315ff88a" released by "delete_snapshot" :: held 3.998s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:32:58 devstack cinder-volume[87172]: WARNING cinder.quota [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1803052769 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1803052769, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:32:58 devstack cinder-volume[87172]: WARNING cinder.quota [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1803052769 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1803052769, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:32:58 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] Created reservations ['1c4a0263-1435-424c-b9a2-61900cd461a3', '7f9e9623-216f-46c3-b201-4c519e54a8cf', '2efd427f-7549-4df6-81e3-02340adbfb7e', 'd04ef3be-c81e-432a-a62c-e805105b0de9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:32:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7f778f1d-aa5a-4413-87db-c932275af266 tempest-GroupSnapshotsV319Test-2137229546 None] group_snapshot 5f04a5af-0527-4a3f-8a9f-7781ac93e499: deleted successfully Jul 08 19:32:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "cinder-quobyte-e2789178-c627-4c99-a413-e948315ff88a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:32:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "cinder-quobyte-e2789178-c627-4c99-a413-e948315ff88a" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:32:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2863b488-bac1-41eb-8694-e5effa68ce5a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:32:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:32:59 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a Jul 08 19:32:59 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:00 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a" returned: 0 in 0.849s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:00 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a Jul 08 19:33:00 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:00 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e2789178-c627-4c99-a413-e948315ff88a" returned: 0 in 0.716s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "cinder-quobyte-e2789178-c627-4c99-a413-e948315ff88a" released by "delete_volume" :: held 1.631s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:00 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Created reservations ['1777025b-7b22-42ac-ab81-1bb401d5240c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:00 devstack cinder-volume[87172]: WARNING cinder.quota [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1803052769 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1803052769, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:33:00 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Created reservations ['193a61a2-ed41-4446-818a-197e379574f5', '5dfe17b1-9170-4144-8f2b-38add2a3a6dd', 'fe7d6e7f-77a7-4a1a-aec2-619f6475178a', '80f27197-088b-4663-9091-a5340041d9d3'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:01 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:01 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:01 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-a3373a12-304b-446d-820b-a054b84360d7 req-cc0b8022-3c72-4d07-b028-56d113e1056c tempest-TaggedAttachmentsTest-2135435323 None] Terminate volume connection completed successfully. Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-a3373a12-304b-446d-820b-a054b84360d7 req-cc0b8022-3c72-4d07-b028-56d113e1056c tempest-TaggedAttachmentsTest-2135435323 None] Deleting attachment 70fa9cf5-8666-4661-9cef-8321e223d583. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:33:01 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.782s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:01 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:01 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-16dff9c9-3ac2-4997-ae54-7a2d1b13cbc3 tempest-GroupSnapshotsV319Test-2137229546 None] Delete group completed successfully. Jul 08 19:33:11 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=46,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:33:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:11 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b6cee-0de8-4c67-8f16-c52a9568545a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:11 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 Jul 08 19:33:11 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:12 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744" returned: 0 in 1.331s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.365s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:12 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=52,cinder:INSERT=10,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:33:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-ee84073e-e91a-4973-9331-098b9d769744', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34ba4f0f-6335-4483-acea-446238a6a875', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:33:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-05359ad3-e1cd-45df-9c4c-84ac05f26893 req-1652f94a-afec-4a7f-998c-891f462d3d50 tempest-ServerActionsTestOtherA-618711776 None] attachment_update completed successfully. Jul 08 19:33:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7f943309-02b5-4997-810e-09c539431621 tempest-GroupsTest-502064336 None] Group tempest-Group1-1526873044: creating Jul 08 19:33:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7f943309-02b5-4997-810e-09c539431621 tempest-GroupsTest-502064336 None] Group tempest-Group1-1526873044: created successfully Jul 08 19:33:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7f943309-02b5-4997-810e-09c539431621 tempest-GroupsTest-502064336 None] Create group completed successfully. Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Flow 'volume_create_manager' (df9bb19a-8d48-4d0d-85f9-e4d58066b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bd675c-31c2-4275-bf79-40ecad0c35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bd675c-31c2-4275-bf79-40ecad0c35ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2135112964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa64516-c04e-4002-bd44-6cad7a59996e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3e43ff9dec48ae99b0ba91a5906dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:16Z,use_quota=True,user_id='ea5cdafdc09249159cb5e2a5c852b1ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf763d9-4992-479c-8839-0b295e35c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf763d9-4992-479c-8839-0b295e35c08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e86ea5-5952-4ac3-b625-5677f2febded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e86ea5-5952-4ac3-b625-5677f2febded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa64516-c04e-4002-bd44-6cad7a59996e', 'volume_name': 'volume-4aa64516-c04e-4002-bd44-6cad7a59996e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4042e4f-1408-4292-8604-5c71cb57dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4042e4f-1408-4292-8604-5c71cb57dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c903aa81-12f9-4f29-bec8-ee0428e61767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:16 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Volume 4aa64516-c04e-4002-bd44-6cad7a59996e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa64516-c04e-4002-bd44-6cad7a59996e', 'volume_size': 1} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2135112964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa64516-c04e-4002-bd44-6cad7a59996e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3e43ff9dec48ae99b0ba91a5906dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:16Z,use_quota=True,user_id='ea5cdafdc09249159cb5e2a5c852b1ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Creating volume 4aa64516-c04e-4002-bd44-6cad7a59996e {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:33:16 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:33:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:16 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e 1073741824 Jul 08 19:33:16 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:16 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-14d0f92e-26bd-4ea7-ba8f-d1283da5fdea tempest-GroupsTest-502064336 None] Group tempest-Group2-228281804: creating Jul 08 19:33:16 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-14d0f92e-26bd-4ea7-ba8f-d1283da5fdea tempest-GroupsTest-502064336 None] Group tempest-Group2-228281804: created successfully Jul 08 19:33:16 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-14d0f92e-26bd-4ea7-ba8f-d1283da5fdea tempest-GroupsTest-502064336 None] Create group completed successfully. Jul 08 19:33:17 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e 1073741824" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:17 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e Jul 08 19:33:17 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:18 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e" returned: 0 in 0.768s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c903aa81-12f9-4f29-bec8-ee0428e61767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa64516-c04e-4002-bd44-6cad7a59996e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317eae20-fd34-4a98-8525-e55fc27a41fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:18 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Volume volume-4aa64516-c04e-4002-bd44-6cad7a59996e (4aa64516-c04e-4002-bd44-6cad7a59996e): created successfully Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317eae20-fd34-4a98-8525-e55fc27a41fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Flow 'volume_create_manager' (df9bb19a-8d48-4d0d-85f9-e4d58066b712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d84347d3-7a33-4a27-844e-a11c0342f4ef tempest-VolumesAdminNegativeTest-650889894 None] Created volume successfully. Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Flow 'volume_create_manager' (b6efe34f-3619-4554-bdc7-3beeb0c59f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42423fed-a3bc-404a-b4e1-7631662c3e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42423fed-a3bc-404a-b4e1-7631662c3e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-521237893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef23c9f6-7ffc-4620-85e3-7db13dd483bc,host='devstack@QuobyteHD#QuobyteHD',id=9fad2d57-eec1-4063-9f5a-3a1808febaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd32f6d674ee4299a4391b73bff0a44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:19Z,use_quota=True,user_id='5dd29eb9309f46d2aad7994ba7117927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f0f92b0-c47b-48b8-8b1b-f97416aef9c3),volume_type_id=9f0f92b0-c47b-48b8-8b1b-f97416aef9c3)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbd4f32-a56b-48ad-8a39-cb7b47cb7484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbd4f32-a56b-48ad-8a39-cb7b47cb7484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3c10cd-e900-4431-b596-309d8c404c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3c10cd-e900-4431-b596-309d8c404c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fad2d57-eec1-4063-9f5a-3a1808febaee', 'volume_name': 'volume-9fad2d57-eec1-4063-9f5a-3a1808febaee', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a562e33c-fca0-45e3-b09e-2824f356ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a562e33c-fca0-45e3-b09e-2824f356ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56571416-0398-4f39-9901-964b5a992b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Volume 9fad2d57-eec1-4063-9f5a-3a1808febaee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fad2d57-eec1-4063-9f5a-3a1808febaee', 'volume_size': 1} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef23c9f6-7ffc-4620-85e3-7db13dd483bc,created_at=2026-07-08T17:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-521237893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef23c9f6-7ffc-4620-85e3-7db13dd483bc,host='devstack@QuobyteHD#QuobyteHD',id=9fad2d57-eec1-4063-9f5a-3a1808febaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd32f6d674ee4299a4391b73bff0a44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:19Z,use_quota=True,user_id='5dd29eb9309f46d2aad7994ba7117927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f0f92b0-c47b-48b8-8b1b-f97416aef9c3),volume_type_id=9f0f92b0-c47b-48b8-8b1b-f97416aef9c3)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Creating volume 9fad2d57-eec1-4063-9f5a-3a1808febaee {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:33:19 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:19 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee 1073741824 Jul 08 19:33:19 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Acquiring lock "cinder-4aa64516-c04e-4002-bd44-6cad7a59996e-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Lock "cinder-4aa64516-c04e-4002-bd44-6cad7a59996e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Acquiring lock "cinder-quobyte-4aa64516-c04e-4002-bd44-6cad7a59996e" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Lock "cinder-quobyte-4aa64516-c04e-4002-bd44-6cad7a59996e" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8caf1f4-f480-4111-b4fd-99b36b030ec7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:20 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e Jul 08 19:33:20 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:20 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee 1073741824" returned: 0 in 1.400s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:20 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee Jul 08 19:33:20 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:21 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e" returned: 0 in 1.292s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:21 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e Jul 08 19:33:21 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:22 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee" returned: 0 in 1.272s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] <== create_volume: return (2753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.763s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Acquiring lock "cinder-2372666c-8ad0-4343-8357-dce14e863ace-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56571416-0398-4f39-9901-964b5a992b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fad2d57-eec1-4063-9f5a-3a1808febaee', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cf4723-fcf3-48fd-a8fd-c404e78e8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Lock "cinder-2372666c-8ad0-4343-8357-dce14e863ace-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Volume volume-9fad2d57-eec1-4063-9f5a-3a1808febaee (9fad2d57-eec1-4063-9f5a-3a1808febaee): created successfully Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cf4723-fcf3-48fd-a8fd-c404e78e8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Flow 'volume_create_manager' (b6efe34f-3619-4554-bdc7-3beeb0c59f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-059c2cc2-6141-4419-b7c2-f626fc2b4c56 tempest-ServerActionsTestOtherA-618711776 None] Terminate volume connection completed successfully. Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-059c2cc2-6141-4419-b7c2-f626fc2b4c56 tempest-ServerActionsTestOtherA-618711776 None] Deleting attachment 34ba4f0f-6335-4483-acea-446238a6a875. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:33:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ee351f25-0891-4e15-952d-4262c23b80e8 tempest-GroupsTest-502064336 None] Created volume successfully. Jul 08 19:33:22 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Acquiring lock "cinder-quobyte-2372666c-8ad0-4343-8357-dce14e863ace" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4aa64516-c04e-4002-bd44-6cad7a59996e" returned: 0 in 1.241s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Lock "cinder-quobyte-4aa64516-c04e-4002-bd44-6cad7a59996e" released by "delete_volume" :: held 2.606s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Lock "cinder-quobyte-2372666c-8ad0-4343-8357-dce14e863ace" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8de4032-70d2-4f3d-9d5d-ebe86aa1d6a1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Created reservations ['66c955b8-96a3-437e-b01e-1c7a17b2e6d6', '4617e669-9ca1-415e-bf50-7f5bfa63c1d6', '58011a2f-055e-44bb-9366-153341bc45a4', '687a6bd2-d2c1-4740-9c44-936946ff13dc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:22 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace Jul 08 19:33:22 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:22 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:22 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:23 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:23 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace" returned: 0 in 1.251s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.140s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:23 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Deleted volume successfully. Jul 08 19:33:23 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace Jul 08 19:33:23 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb603a1a-25cc-4a2a-9e8c-6d47fb27dcb0 tempest-VolumesAdminNegativeTest-650889894 None] Lock "cinder-4aa64516-c04e-4002-bd44-6cad7a59996e-delete_volume" released by "delete_volume" :: held 4.094s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Acquiring lock "cinder-quobyte-9fad2d57-eec1-4063-9f5a-3a1808febaee" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Lock "cinder-quobyte-9fad2d57-eec1-4063-9f5a-3a1808febaee" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5659d-dc4a-4754-bf67-8fc133c62592]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:24 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:24 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee Jul 08 19:33:24 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2372666c-8ad0-4343-8357-dce14e863ace" returned: 0 in 1.212s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Lock "cinder-quobyte-2372666c-8ad0-4343-8357-dce14e863ace" released by "delete_volume" :: held 2.515s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[de928bfd-ff56-45c2-8cd9-67054d48a041]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:24 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Created reservations ['16dc969e-ab97-46ea-8d41-8baa00ba4bd7', 'ce4959a2-2fcc-4629-ba1e-8df9a3236d86', '0e171f09-5736-47ff-8919-111932251458', '0fe21d86-1652-4a07-aea0-42c6be67ad1c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:25 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:25 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:25 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:25 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:25 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.910s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Deleted volume successfully. Jul 08 19:33:25 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee" returned: 0 in 1.263s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d0c95495-2318-4e7c-bf24-40e5ce99aa5e tempest-TaggedAttachmentsTest-2135435323 None] Lock "cinder-2372666c-8ad0-4343-8357-dce14e863ace-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:26 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee Jul 08 19:33:26 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:26 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744" returned: 0 in 1.185s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.205s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-ee84073e-e91a-4973-9331-098b9d769744', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4ccaf6e-7ac6-43cc-a75a-44deccf7cbf7', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:33:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-b81ed85d-63f5-47cd-a7d6-286a869fdf73 req-06050bb1-e846-43a7-b0b2-86c0967af77e tempest-ServerActionsTestOtherA-618711776 None] attachment_update completed successfully. Jul 08 19:33:26 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9fad2d57-eec1-4063-9f5a-3a1808febaee" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Lock "cinder-quobyte-9fad2d57-eec1-4063-9f5a-3a1808febaee" released by "delete_volume" :: held 2.193s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Created reservations ['8e8142f5-eb5b-41bc-8e3e-0fd6f660a753'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:26 devstack cinder-volume[87172]: WARNING cinder.quota [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-97802619 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-97802619, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:33:26 devstack cinder-volume[87172]: WARNING cinder.quota [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-97802619 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-97802619, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:33:26 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Created reservations ['52561216-0543-4fb6-8421-52464b774683', 'c64aea9a-0475-469d-9f42-97798326d4be', '507946f0-ee36-47b7-863e-3e07e42b2015', '9830b4c2-5f5f-451b-8bc6-caa0205e67ba'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:27 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:27 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:27 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.634s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:27 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-56f81ba0-16a3-4da3-9010-416444e2da5e tempest-GroupsTest-502064336 None] Delete group completed successfully. Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Created reservations ['0c711b94-2605-4111-adf3-2def13c75af4'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:28 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:28 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:29 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.705s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:29 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a7fb59b8-c730-4159-9ca4-17aa543132c9 tempest-GroupsTest-502064336 None] Delete group completed successfully. Jul 08 19:33:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-37e40b0d-792b-4ac4-82a3-e1dd285a7e97 tempest-GroupsTest-502064336 None] Group tempest-GroupsTest-Group-1792675505: creating Jul 08 19:33:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-37e40b0d-792b-4ac4-82a3-e1dd285a7e97 tempest-GroupsTest-502064336 None] Group tempest-GroupsTest-Group-1792675505: created successfully Jul 08 19:33:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-37e40b0d-792b-4ac4-82a3-e1dd285a7e97 tempest-GroupsTest-502064336 None] Create group completed successfully. Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Flow 'volume_create_manager' (3f0062d6-38a8-40ef-923d-32f60de90ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2bdad9-c1dc-42f2-b79b-de54c96de477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2bdad9-c1dc-42f2-b79b-de54c96de477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880931426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9a83061-806d-446f-a1c2-dc976a122967,host='devstack@QuobyteHD#QuobyteHD',id=3d84ab17-a614-4067-8685-be6bb4503dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd32f6d674ee4299a4391b73bff0a44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:32Z,use_quota=True,user_id='5dd29eb9309f46d2aad7994ba7117927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc37708-3b84-465f-8cf6-e090b8b0e531),volume_type_id=ccc37708-3b84-465f-8cf6-e090b8b0e531)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ed9ad3-a770-4e04-9bdf-78b0bed8f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ed9ad3-a770-4e04-9bdf-78b0bed8f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e2359f-a6e6-4c8b-9719-27d1c80302c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e2359f-a6e6-4c8b-9719-27d1c80302c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d84ab17-a614-4067-8685-be6bb4503dc7', 'volume_name': 'volume-3d84ab17-a614-4067-8685-be6bb4503dc7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eac343f-e77a-4026-a0d4-ebcde519a50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eac343f-e77a-4026-a0d4-ebcde519a50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7683843c-f39d-4930-b640-f463c3bdf7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Volume 3d84ab17-a614-4067-8685-be6bb4503dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d84ab17-a614-4067-8685-be6bb4503dc7', 'volume_size': 1} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9a83061-806d-446f-a1c2-dc976a122967,created_at=2026-07-08T17:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880931426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9a83061-806d-446f-a1c2-dc976a122967,host='devstack@QuobyteHD#QuobyteHD',id=3d84ab17-a614-4067-8685-be6bb4503dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd32f6d674ee4299a4391b73bff0a44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:32Z,use_quota=True,user_id='5dd29eb9309f46d2aad7994ba7117927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc37708-3b84-465f-8cf6-e090b8b0e531),volume_type_id=ccc37708-3b84-465f-8cf6-e090b8b0e531)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Creating volume 3d84ab17-a614-4067-8685-be6bb4503dc7 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:33:31 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:33:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:31 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 1073741824 Jul 08 19:33:31 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:32 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 1073741824" returned: 0 in 1.008s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:33 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 Jul 08 19:33:33 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:33 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7" returned: 0 in 0.754s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7683843c-f39d-4930-b640-f463c3bdf7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d84ab17-a614-4067-8685-be6bb4503dc7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadb1d7f-b85c-4410-bc56-8e39c92434c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:33 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Volume volume-3d84ab17-a614-4067-8685-be6bb4503dc7 (3d84ab17-a614-4067-8685-be6bb4503dc7): created successfully Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadb1d7f-b85c-4410-bc56-8e39c92434c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Flow 'volume_create_manager' (3f0062d6-38a8-40ef-923d-32f60de90ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:33 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ecb463df-61a3-401b-9bef-a731e00cea45 tempest-GroupsTest-502064336 None] Created volume successfully. Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:34 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:34 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:35 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:33:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Flow 'volume_create_manager' (ccd4b97d-e5cb-424e-9bc7-b43af5ffa153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f763a81-7231-475d-8e40-458afd7d88cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f763a81-7231-475d-8e40-458afd7d88cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424362584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9a83061-806d-446f-a1c2-dc976a122967,host='devstack@QuobyteHD#QuobyteHD',id=6733b330-b2b9-4d52-a323-a071a37f1f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd32f6d674ee4299a4391b73bff0a44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:36Z,use_quota=True,user_id='5dd29eb9309f46d2aad7994ba7117927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc37708-3b84-465f-8cf6-e090b8b0e531),volume_type_id=ccc37708-3b84-465f-8cf6-e090b8b0e531)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8c5b1a-7bd0-4157-b0cd-14fd07310498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8c5b1a-7bd0-4157-b0cd-14fd07310498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc890fb-121a-4ab1-a343-bd41c33813cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc890fb-121a-4ab1-a343-bd41c33813cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6733b330-b2b9-4d52-a323-a071a37f1f5d', 'volume_name': 'volume-6733b330-b2b9-4d52-a323-a071a37f1f5d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5508e18f-9b4e-41af-b985-1d25f3542425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5508e18f-9b4e-41af-b985-1d25f3542425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d8b011-8a9c-47d2-a06d-b851d1f639de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:36 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Volume 6733b330-b2b9-4d52-a323-a071a37f1f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6733b330-b2b9-4d52-a323-a071a37f1f5d', 'volume_size': 1} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9a83061-806d-446f-a1c2-dc976a122967,created_at=2026-07-08T17:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424362584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9a83061-806d-446f-a1c2-dc976a122967,host='devstack@QuobyteHD#QuobyteHD',id=6733b330-b2b9-4d52-a323-a071a37f1f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd32f6d674ee4299a4391b73bff0a44c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:36Z,use_quota=True,user_id='5dd29eb9309f46d2aad7994ba7117927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc37708-3b84-465f-8cf6-e090b8b0e531),volume_type_id=ccc37708-3b84-465f-8cf6-e090b8b0e531)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Creating volume 6733b330-b2b9-4d52-a323-a071a37f1f5d {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:33:36 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:36 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d 1073741824 Jul 08 19:33:36 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:36 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.487s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:33:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:33:37 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d 1073741824" returned: 0 in 1.189s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:37 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d Jul 08 19:33:37 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:38 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d" returned: 0 in 0.814s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d8b011-8a9c-47d2-a06d-b851d1f639de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6733b330-b2b9-4d52-a323-a071a37f1f5d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d335b1-47b7-4b2d-ad04-90edfd178f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:38 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Volume volume-6733b330-b2b9-4d52-a323-a071a37f1f5d (6733b330-b2b9-4d52-a323-a071a37f1f5d): created successfully Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d335b1-47b7-4b2d-ad04-90edfd178f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Flow 'volume_create_manager' (ccd4b97d-e5cb-424e-9bc7-b43af5ffa153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:38 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f41c15a6-7c0f-473c-98d4-c35d84b044e7 tempest-GroupsTest-502064336 None] Created volume successfully. Jul 08 19:33:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9b130f77-37ae-460c-9ae6-ef3fb30a398b tempest-GroupsTest-502064336 None] Update group completed successfully. Jul 08 19:33:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c34ef1a6-10b6-4eba-ac84-ce28aa1f066f tempest-GroupsTest-502064336 None] Update group completed successfully. Jul 08 19:33:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Acquiring lock "cinder-quobyte-3d84ab17-a614-4067-8685-be6bb4503dc7" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Lock "cinder-quobyte-3d84ab17-a614-4067-8685-be6bb4503dc7" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cd705-9fa5-4c06-99df-a1d06ad815c8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:42 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 Jul 08 19:33:42 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:44 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7" returned: 0 in 1.182s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:44 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7 Jul 08 19:33:44 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:44 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3d84ab17-a614-4067-8685-be6bb4503dc7" returned: 0 in 0.892s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Lock "cinder-quobyte-3d84ab17-a614-4067-8685-be6bb4503dc7" released by "delete_volume" :: held 2.180s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Acquiring lock "cinder-quobyte-6733b330-b2b9-4d52-a323-a071a37f1f5d" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:33:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Lock "cinder-quobyte-6733b330-b2b9-4d52-a323-a071a37f1f5d" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:33:45 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[399078ad-2c05-4eab-bb54-860032fac64b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:33:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:45 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d Jul 08 19:33:45 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:46 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d" returned: 0 in 1.043s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:46 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d Jul 08 19:33:46 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:47 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6733b330-b2b9-4d52-a323-a071a37f1f5d" returned: 0 in 0.954s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Lock "cinder-quobyte-6733b330-b2b9-4d52-a323-a071a37f1f5d" released by "delete_volume" :: held 2.073s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Created reservations ['2250ad0f-647f-4f36-82b2-1a39cd30213a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:47 devstack cinder-volume[87172]: WARNING cinder.quota [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1706661365 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1706661365, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:33:47 devstack cinder-volume[87172]: WARNING cinder.quota [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1706661365 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1706661365, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Created reservations ['f175d706-7f49-436c-9db5-f4431ddb116f', '41156e83-4005-48ec-81e3-8abacd4ca257', '71b98da4-de99-4526-b5f8-de4e8748fda8', 'b2ee11af-482f-43af-bb5e-0a91aebe3ed5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Created reservations ['72749fc9-3644-44b2-8315-2db020394413', '840eb5c1-6fe9-42ed-91fa-a504fd560d3c', '9bf5c8c2-10fe-475f-8fc2-b05751986530', '6b0c6ee4-b121-4416-8b20-b8bf46dc1a16'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:47 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:33:47 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:48 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.836s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:48 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:33:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a1bf52b2-d15a-4909-bbb3-454ee72ee6ef tempest-GroupsTest-502064336 None] Delete group completed successfully. Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Flow 'volume_create_manager' (736e64ce-ba0f-4e4e-8459-1fd9e0fff0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a99144c-6d50-45c6-9e50-2adaea0687b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a99144c-6d50-45c6-9e50-2adaea0687b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2031865857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2865ab20ec4db08a05f5fdd12c57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:57Z,use_quota=True,user_id='3bb3b87f2fa749c180d0e4b2602dfff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2553eeb2-2bc7-4670-873f-e7f87d3f04fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2553eeb2-2bc7-4670-873f-e7f87d3f04fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c1d6cc-3075-4c8a-9560-39d1b8043884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c1d6cc-3075-4c8a-9560-39d1b8043884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6', 'volume_name': 'volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075cfa35-104f-4745-9e15-33a812f23b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075cfa35-104f-4745-9e15-33a812f23b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efdbb3-5478-4cc6-8265-905105dea41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:57 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6', 'volume_size': 1} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2031865857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2865ab20ec4db08a05f5fdd12c57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:33:57Z,use_quota=True,user_id='3bb3b87f2fa749c180d0e4b2602dfff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Creating volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:33:57 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:33:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:57 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 1073741824 Jul 08 19:33:57 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:58 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 1073741824" returned: 0 in 1.376s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:33:58 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 Jul 08 19:33:58 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:33:59 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efdbb3-5478-4cc6-8265-905105dea41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d72bee-96fd-4d19-b237-f3680300e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:33:59 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Volume volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 (c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6): created successfully Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d72bee-96fd-4d19-b237-f3680300e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Flow 'volume_create_manager' (736e64ce-ba0f-4e4e-8459-1fd9e0fff0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:33:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9978e77b-2a0f-4883-a712-5a7b32af1ce3 tempest-SnapshotsActionsTest-1548975897 None] Created volume successfully. Jul 08 19:33:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-7ce27ebd-93d7-4b81-9194-22edb9760240 req-f5d57aa3-60bb-4b9f-b4d1-475c7fd8193e tempest-ServerActionsTestOtherA-618711776 None] Terminate volume connection completed successfully. Jul 08 19:33:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-7ce27ebd-93d7-4b81-9194-22edb9760240 req-f5d57aa3-60bb-4b9f-b4d1-475c7fd8193e tempest-ServerActionsTestOtherA-618711776 None] Deleting attachment b4ccaf6e-7ac6-43cc-a75a-44deccf7cbf7. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:34:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Creating offline snapshot ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:34:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5699a869-006c-471c-8fd6-7e84b8004a4d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:00 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 Jul 08 19:34:00 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:01 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" returned: 0 in 0.854s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:01 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 1G Jul 08 19:34:01 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:02 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 1G" returned: 0 in 1.260s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:02 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:02 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:03 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 0.996s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:03 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 is being set with open permissions: ugo+rw Jul 08 19:34:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:03 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:03 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:04 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 0.831s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:04 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info Jul 08 19:34:04 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:05 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info" returned: 0 in 0.890s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:05 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info is being set with open permissions: ugo+rw Jul 08 19:34:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:05 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info Jul 08 19:34:05 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:06 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.info" returned: 0 in 0.786s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.730s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f767a564-83f0-4bf3-b379-cac8f7d79410 tempest-SnapshotsActionsTest-1548975897 None] Create snapshot completed successfully Jul 08 19:34:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Creating offline snapshot e1015b97-9f04-4b4a-8493-787bf3e70fde of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:34:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bbeee2-1101-4fc4-a83b-8db7e54ba2ad]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:07 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:07 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:08 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 0.902s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:08 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde 1G Jul 08 19:34:08 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:09 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde 1G" returned: 0 in 1.169s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:09 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde Jul 08 19:34:09 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:11 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde" returned: 0 in 1.312s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:11 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde is being set with open permissions: ugo+rw Jul 08 19:34:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:11 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde Jul 08 19:34:11 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:12 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde" returned: 0 in 1.116s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:12 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=78,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=9 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:34:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.696s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0384e558-8fa0-4a52-8c5c-7ac43d00e21c tempest-SnapshotsActionsTest-1548975897 None] Create snapshot completed successfully Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-e1015b97-9f04-4b4a-8493-787bf3e70fde-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-e1015b97-9f04-4b4a-8493-787bf3e70fde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-e1015b97-9f04-4b4a-8493-787bf3e70fde" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-e1015b97-9f04-4b4a-8493-787bf3e70fde" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Deleting offline snapshot e1015b97-9f04-4b4a-8493-787bf3e70fde of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] snapshot_file for this snap is: volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d213c71f-eba6-4963-848d-fa438ce312e7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:13 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde Jul 08 19:34:13 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "cinder-ee84073e-e91a-4973-9331-098b9d769744-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Lock "cinder-ee84073e-e91a-4973-9331-098b9d769744-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=72,cinder:UPDATE=75,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "cinder-quobyte-ee84073e-e91a-4973-9331-098b9d769744" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Lock "cinder-quobyte-ee84073e-e91a-4973-9331-098b9d769744" acquired by "delete_volume" :: waited 0.060s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e476412-52bf-4c76-8e70-9c47ec4f7c07]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:14 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde" returned: 0 in 1.263s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:14 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 Jul 08 19:34:14 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752c108-a202-4ae5-8943-e2cc4445b827]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:14 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:14 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:16 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744" returned: 0 in 1.763s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:16 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744 Jul 08 19:34:16 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:16 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.683s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:16 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde Jul 08 19:34:16 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:18 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde" returned: 0 in 1.718s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:18 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde Jul 08 19:34:18 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:18 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee84073e-e91a-4973-9331-098b9d769744" returned: 0 in 2.033s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Lock "cinder-quobyte-ee84073e-e91a-4973-9331-098b9d769744" released by "delete_volume" :: held 3.932s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Created reservations ['eec0a738-6df7-4745-ae9e-7e6ca0bd27e4', '5dcd5acf-48a4-4def-8396-ddf31dcf2c17', '0a275d4b-24ab-49ae-a5e9-90092ac409bb', '684b9406-81e1-44e0-9664-d785c5794467'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:18 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:34:18 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:19 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.e1015b97-9f04-4b4a-8493-787bf3e70fde" returned: 0 in 1.909s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:19 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.281s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-e1015b97-9f04-4b4a-8493-787bf3e70fde" released by "_delete_snapshot" :: held 6.766s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Deleted volume successfully. Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" released by "delete_snapshot" :: held 6.814s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2b298218-d26b-485b-9627-60ff609cee68 tempest-ServerActionsTestOtherA-618711776 None] Lock "cinder-ee84073e-e91a-4973-9331-098b9d769744-delete_volume" released by "delete_volume" :: held 6.032s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:20 devstack cinder-volume[87172]: WARNING cinder.quota [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Created reservations ['60a3a071-4935-4e7d-88b3-0651615f31bd', 'd9fdd55a-0e43-4bdd-ba4a-cbb79614c402', '5238933b-62b6-4f3f-b2ec-20e40fb8d9d6', '99bc53a1-a5fc-4bd6-afb8-243fde5461bc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:34:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Delete snapshot completed successfully. Jul 08 19:34:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d276eaaa-edf4-4143-b04c-391ad9e246e6 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-e1015b97-9f04-4b4a-8493-787bf3e70fde-delete_snapshot" released by "delete_snapshot" :: held 7.071s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Creating offline snapshot 6ccc7aaf-e74a-4482-8846-33d59460f9bc of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:34:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0848ac-d398-4754-8601-616f8b6ec59f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:21 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:21 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:22 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.157s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:22 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc 1G Jul 08 19:34:22 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:23 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc 1G" returned: 0 in 1.246s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:23 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc Jul 08 19:34:23 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:24 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc" returned: 0 in 0.830s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:24 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc is being set with open permissions: ugo+rw Jul 08 19:34:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:24 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc Jul 08 19:34:24 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:25 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc" returned: 0 in 1.067s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.453s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4d327169-2f3a-4e9b-92a2-123bf0028181 tempest-SnapshotsActionsTest-1548975897 None] Create snapshot completed successfully Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-6ccc7aaf-e74a-4482-8846-33d59460f9bc-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-6ccc7aaf-e74a-4482-8846-33d59460f9bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-6ccc7aaf-e74a-4482-8846-33d59460f9bc" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-6ccc7aaf-e74a-4482-8846-33d59460f9bc" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Deleting offline snapshot 6ccc7aaf-e74a-4482-8846-33d59460f9bc of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] snapshot_file for this snap is: volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[951632c8-f074-40e9-a720-0e5ac716bea2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:27 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc Jul 08 19:34:27 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:28 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc" returned: 0 in 1.400s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf72e22c-956c-4f61-bca2-8d1b1b79fdc9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:29 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:29 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:30 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.775s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:30 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc Jul 08 19:34:30 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Flow 'volume_create_manager' (0502b5d3-6cf7-454b-b425-62391b655998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b369f3e-4ec4-4b3f-bd17-32897f041688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b369f3e-4ec4-4b3f-bd17-32897f041688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1926011275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4630315b-9731-4356-aa3c-c8c8362a03e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863dcc7f6fed47738b4a273e1df66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:34:31Z,use_quota=True,user_id='3dfaf41652144e7299ce2baaaa78c9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c889ab97-e742-4ac5-a4c7-4fc38ff1fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c889ab97-e742-4ac5-a4c7-4fc38ff1fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c609265e-c3ec-4681-a37e-cfa8f0fe469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c609265e-c3ec-4681-a37e-cfa8f0fe469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4630315b-9731-4356-aa3c-c8c8362a03e0', 'volume_name': 'volume-4630315b-9731-4356-aa3c-c8c8362a03e0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf986882-4291-4293-9caf-57711db85604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf986882-4291-4293-9caf-57711db85604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2dc9eb-c250-49be-b4c0-ffc28f5825cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:34:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Volume 4630315b-9731-4356-aa3c-c8c8362a03e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4630315b-9731-4356-aa3c-c8c8362a03e0', 'volume_size': 1} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1926011275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4630315b-9731-4356-aa3c-c8c8362a03e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863dcc7f6fed47738b4a273e1df66120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:34:31Z,use_quota=True,user_id='3dfaf41652144e7299ce2baaaa78c9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Creating volume 4630315b-9731-4356-aa3c-c8c8362a03e0 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:34:31 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:34:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:31 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 1073741824 Jul 08 19:34:31 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:32 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc" returned: 0 in 1.474s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:32 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc Jul 08 19:34:32 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:33 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 1073741824" returned: 0 in 1.795s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:33 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 Jul 08 19:34:33 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:33 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.6ccc7aaf-e74a-4482-8846-33d59460f9bc" returned: 0 in 1.484s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-6ccc7aaf-e74a-4482-8846-33d59460f9bc" released by "_delete_snapshot" :: held 6.420s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" released by "delete_snapshot" :: held 6.504s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Created reservations ['3e182a65-35b4-4171-810e-406716a14521', '4d74e22b-97de-4766-ae66-4dfbf2edbd86', 'f5d4da57-214c-4082-b42f-38469ea4ae26', '126ac0ac-ffb8-4fe1-9065-6d4434894126'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:34:33 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Delete snapshot completed successfully. Jul 08 19:34:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a049d8a9-7412-4608-8cc9-dcfd029f245d tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-6ccc7aaf-e74a-4482-8846-33d59460f9bc-delete_snapshot" released by "delete_snapshot" :: held 6.815s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:34 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0" returned: 0 in 1.185s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] <== create_volume: return (3083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.086s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2dc9eb-c250-49be-b4c0-ffc28f5825cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4630315b-9731-4356-aa3c-c8c8362a03e0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15c5801-4c98-4782-86d1-33ce54634f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:34:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Volume volume-4630315b-9731-4356-aa3c-c8c8362a03e0 (4630315b-9731-4356-aa3c-c8c8362a03e0): created successfully Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15c5801-4c98-4782-86d1-33ce54634f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Flow 'volume_create_manager' (0502b5d3-6cf7-454b-b425-62391b655998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1d3eb8cb-91d8-4121-8a7f-92d2ca4f2437 tempest-ServerRescueNegativeTestJSON-652218123 None] Created volume successfully. Jul 08 19:34:34 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:34:34 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Creating offline snapshot 49c8955f-1006-4868-8e16-c35a4ecda392 of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:34:35 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5865996-0f26-4c7f-a15c-2fe6d7d09fcd]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:36 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:36 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:36 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.801s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:36 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:34:36 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:34:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:34:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:34:37 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.882s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:37 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 1G Jul 08 19:34:37 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:39 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 1G" returned: 0 in 1.689s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:39 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 Jul 08 19:34:39 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:40 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392" returned: 0 in 1.346s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:40 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 is being set with open permissions: ugo+rw Jul 08 19:34:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:40 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 Jul 08 19:34:40 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:41 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392" returned: 0 in 1.236s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.407s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9d33fc8a-4c75-4fdb-9519-8486ffe977a1 tempest-SnapshotsActionsTest-1548975897 None] Create snapshot completed successfully Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-49c8955f-1006-4868-8e16-c35a4ecda392-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-49c8955f-1006-4868-8e16-c35a4ecda392-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-49c8955f-1006-4868-8e16-c35a4ecda392" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-49c8955f-1006-4868-8e16-c35a4ecda392" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Deleting offline snapshot 49c8955f-1006-4868-8e16-c35a4ecda392 of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] snapshot_file for this snap is: volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd433f-e58b-4f7d-91ce-aea1136b3086]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:42 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 Jul 08 19:34:42 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:44 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392" returned: 0 in 1.494s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae6c79-3e90-4aea-b659-bc60b191a9e6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:44 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:44 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:45 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.185s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:45 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 Jul 08 19:34:45 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:46 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392" returned: 0 in 1.091s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:46 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392 Jul 08 19:34:46 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:47 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.49c8955f-1006-4868-8e16-c35a4ecda392" returned: 0 in 0.737s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-49c8955f-1006-4868-8e16-c35a4ecda392" released by "_delete_snapshot" :: held 4.672s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" released by "delete_snapshot" :: held 4.709s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Created reservations ['8ba67f26-c665-4766-b85b-9104e9adbd18', '5e6602c4-ab2f-4c19-a728-2460ea8d55d1', '739a5a95-55ca-4638-ab18-e039227b7377', '42bf4aea-00d0-4f64-8b41-e6d0fd8785f4'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:34:47 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Delete snapshot completed successfully. Jul 08 19:34:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-060f3001-2820-4731-a07d-9ecd0b95bda2 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-49c8955f-1006-4868-8e16-c35a4ecda392-delete_snapshot" released by "delete_snapshot" :: held 4.937s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:34:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:34:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Creating offline snapshot 35e2810c-8584-43ec-b4f1-dde063137078 of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:34:48 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0af417f-a5bd-4f6f-ba36-3c248f76b361]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:48 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:48 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:49 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 0.932s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:49 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 1G Jul 08 19:34:49 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:50 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 1G" returned: 0 in 1.545s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:51 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 Jul 08 19:34:51 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:52 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078" returned: 0 in 1.710s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:52 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 is being set with open permissions: ugo+rw Jul 08 19:34:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:52 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 Jul 08 19:34:52 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:54 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078" returned: 0 in 1.611s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.983s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:34:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-463a8122-27aa-4201-8396-73d0b432d005 tempest-SnapshotsActionsTest-1548975897 None] Create snapshot completed successfully Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-35e2810c-8584-43ec-b4f1-dde063137078-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-35e2810c-8584-43ec-b4f1-dde063137078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Acquiring lock "cinder-quobyte-35e2810c-8584-43ec-b4f1-dde063137078" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-35e2810c-8584-43ec-b4f1-dde063137078" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Deleting offline snapshot 35e2810c-8584-43ec-b4f1-dde063137078 of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] snapshot_file for this snap is: volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[65996e0b-00a9-41f9-b0d2-7017d9409484]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:55 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 Jul 08 19:34:55 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:56 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078" returned: 0 in 1.154s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[767a7a07-61b9-4ead-ad75-0f6ed88db5b4]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:56 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:34:56 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:57 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.050s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:34:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:57 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 Jul 08 19:34:57 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:58 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078" returned: 0 in 1.144s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:58 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078 Jul 08 19:34:58 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Acquiring lock "cinder-4630315b-9731-4356-aa3c-c8c8362a03e0-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "cinder-4630315b-9731-4356-aa3c-c8c8362a03e0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Acquiring lock "cinder-quobyte-4630315b-9731-4356-aa3c-c8c8362a03e0" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "cinder-quobyte-4630315b-9731-4356-aa3c-c8c8362a03e0" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1744e3-54b2-4560-aa2d-0eaff2ec87d3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:34:59 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.35e2810c-8584-43ec-b4f1-dde063137078" returned: 0 in 1.009s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-35e2810c-8584-43ec-b4f1-dde063137078" released by "_delete_snapshot" :: held 4.484s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:34:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" released by "delete_snapshot" :: held 4.548s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:00 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Created reservations ['7c9fc051-5480-42c9-ae2a-666d16191a38', '362a4828-851c-4012-8272-4d888395de08', '5cb01b4f-2452-48af-b8f8-2edca32ac07b', 'dca0c05d-5e2f-4163-ba6a-1f7f33881207'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:35:00 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 Jul 08 19:35:00 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Delete snapshot completed successfully. Jul 08 19:35:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3d1bcd1-43fc-4cf8-b35c-f36ac4e7d285 tempest-SnapshotsActionsTest-649853673 None] Lock "cinder-35e2810c-8584-43ec-b4f1-dde063137078-delete_snapshot" released by "delete_snapshot" :: held 4.902s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:00 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0" returned: 0 in 1.137s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:01 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0 Jul 08 19:35:01 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "cinder-ca3fce9b-6888-4648-a2f1-c76e8ffb2a65-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-ca3fce9b-6888-4648-a2f1-c76e8ffb2a65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "cinder-quobyte-ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-quobyte-ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Deleting offline snapshot ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 of volume c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] snapshot_file for this snap is: volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bdb6d5-3e90-4251-b9cf-d23e80cb6697]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:35:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:01 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:35:01 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:02 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4630315b-9731-4356-aa3c-c8c8362a03e0" returned: 0 in 1.138s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "cinder-quobyte-4630315b-9731-4356-aa3c-c8c8362a03e0" released by "delete_volume" :: held 2.352s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Created reservations ['e0ffce93-9d16-4347-8e7f-eb35ce32fab9', '29a14b5e-5f95-4c04-892e-8d6d8967f722', 'a849014b-ffd0-4b24-a4de-cde6b6bc1185', 'bdb893d7-a450-44ac-96ce-60ea2c5d9bae'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:02 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:35:02 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:02 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.117s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b0fb9-b3e4-42ea-b2b1-b815434533c5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:35:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:02 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 Jul 08 19:35:02 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:03 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.850s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:03 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:35:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Deleted volume successfully. Jul 08 19:35:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e293d57c-a93d-4c7c-97ad-b797ac0c2c08 tempest-ServerRescueNegativeTestJSON-652218123 None] Lock "cinder-4630315b-9731-4356-aa3c-c8c8362a03e0-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:03 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" returned: 0 in 1.158s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:04 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:35:04 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Flow 'volume_create_manager' (7811c26a-0cc1-4eb2-ac47-5ab9e5469b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16035383-6fc0-4e3a-aaf0-acbfc8a9a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16035383-6fc0-4e3a-aaf0-acbfc8a9a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-821837088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9b74df-4783-402a-ab8f-c2c163bc1921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957addf5687f4194a8f14d436fa95ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:04Z,use_quota=True,user_id='f0e2ee46787a4de4a76c50d2c5a8591c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dab45f-6270-41a3-b913-c40cb34dbeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dab45f-6270-41a3-b913-c40cb34dbeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ee27c9-71ac-4622-84a9-bb1ba25e13f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ee27c9-71ac-4622-84a9-bb1ba25e13f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a9b74df-4783-402a-ab8f-c2c163bc1921', 'volume_name': 'volume-3a9b74df-4783-402a-ab8f-c2c163bc1921', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f956a3a1-756c-42f2-bc56-a588e464f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f956a3a1-756c-42f2-bc56-a588e464f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7854833-a2f7-4f0d-81c9-942b2d6d1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:04 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Volume 3a9b74df-4783-402a-ab8f-c2c163bc1921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a9b74df-4783-402a-ab8f-c2c163bc1921', 'volume_size': 1} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-821837088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a9b74df-4783-402a-ab8f-c2c163bc1921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957addf5687f4194a8f14d436fa95ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:04Z,use_quota=True,user_id='f0e2ee46787a4de4a76c50d2c5a8591c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Creating volume 3a9b74df-4783-402a-ab8f-c2c163bc1921 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:35:04 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:04 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 1073741824 Jul 08 19:35:04 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:04 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 0.924s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:04 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65 Jul 08 19:35:04 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:06 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6.ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" returned: 0 in 1.425s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-quobyte-ca3fce9b-6888-4648-a2f1-c76e8ffb2a65" released by "_delete_snapshot" :: held 4.899s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" released by "delete_snapshot" :: held 4.962s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:06 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 1073741824" returned: 0 in 1.841s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Created reservations ['8ac2ac16-faf7-402e-a41c-a12f60a5808a', '86969a10-6fe5-4989-a922-98f0cc7789fa', '4648f2c4-8b4d-4a1a-98d2-c7ee4a1513bd', '971c9873-8589-4122-aa2c-cca47d9e2c23'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:35:06 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 Jul 08 19:35:06 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Delete snapshot completed successfully. Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d47720b-f594-4b32-8a30-3d502a3ca5fc tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-ca3fce9b-6888-4648-a2f1-c76e8ffb2a65-delete_snapshot" released by "delete_snapshot" :: held 5.248s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "cinder-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[47166b01-24b0-4d42-bb14-ce1e71e3ddc5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:07 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 Jul 08 19:35:07 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:07 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921" returned: 0 in 1.232s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] <== create_volume: return (3147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.160s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7854833-a2f7-4f0d-81c9-942b2d6d1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a9b74df-4783-402a-ab8f-c2c163bc1921', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fea0b4-8404-48bf-b4f7-b24d442547f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:07 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Volume volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 (3a9b74df-4783-402a-ab8f-c2c163bc1921): created successfully Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fea0b4-8404-48bf-b4f7-b24d442547f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Flow 'volume_create_manager' (7811c26a-0cc1-4eb2-ac47-5ab9e5469b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fa18ee6f-a6a9-4bf8-ba70-4760d01a6a11 tempest-AttachVolumeNegativeTest-2102385684 None] Created volume successfully. Jul 08 19:35:08 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" returned: 0 in 1.518s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:08 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6 Jul 08 19:35:08 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:09 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" returned: 0 in 1.231s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-quobyte-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6" released by "delete_volume" :: held 2.879s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Created reservations ['8a52fd1e-1ac1-48a0-9524-f931ab081220', '553e2248-0fff-4716-860d-cff7b65fe637', '62d1e4ac-e19d-444d-b1c2-c7031163461c', 'e7fdae0a-51af-43c2-b86e-a8120c2137aa'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:10 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:35:10 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:11 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.889s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:11 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:35:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Deleted volume successfully. Jul 08 19:35:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7cf4de72-7551-4517-a78f-81c378e34bb4 tempest-SnapshotsActionsTest-1548975897 None] Lock "cinder-c269ee3c-0f3b-4d5e-9efc-4cf96e5f47c6-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[41710eb4-f911-4e9d-bac7-5710d36a05e3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:35:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:12 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 Jul 08 19:35:12 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:13 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921" returned: 0 in 0.951s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.973s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:13 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=62,cinder:SELECT=57,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:35:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-3a9b74df-4783-402a-ab8f-c2c163bc1921', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d2d8602-05f9-42ed-afe3-c516d2285efb', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:35:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-8ffb573b-aaa1-4b5a-9e01-7619c52cb056 req-9be73b0d-512e-4f28-9d63-912d422e43d3 tempest-AttachVolumeNegativeTest-2102385684 None] attachment_update completed successfully. Jul 08 19:35:23 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=51,cinder:INSERT=19,cinder:UPDATE=63,cinder:DELETE=2 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:35:23 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=3 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Flow 'volume_create_manager' (c021707c-9e6d-4a03-9fb8-be3c0ac8495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35836f72-e606-4862-8661-89fe721b727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35836f72-e606-4862-8661-89fe721b727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-516956601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb34cd0-63dc-4949-8878-d75331568362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8817d1106df947c4b6caa409a522de51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:27Z,use_quota=True,user_id='1dbd4c03067546dc9a13954090ef6c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e51427-3282-4ad7-9d66-93f9c2566d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e51427-3282-4ad7-9d66-93f9c2566d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd6aa99-ceb4-4fbe-9e6f-1e6dcc52c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd6aa99-ceb4-4fbe-9e6f-1e6dcc52c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb34cd0-63dc-4949-8878-d75331568362', 'volume_name': 'volume-4cb34cd0-63dc-4949-8878-d75331568362', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672a278c-8ff6-49a8-ad1d-cbaa7c65ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672a278c-8ff6-49a8-ad1d-cbaa7c65ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962a4e69-3ad2-47e4-8a65-29e287ee174f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Volume 4cb34cd0-63dc-4949-8878-d75331568362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb34cd0-63dc-4949-8878-d75331568362', 'volume_size': 1} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-516956601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb34cd0-63dc-4949-8878-d75331568362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8817d1106df947c4b6caa409a522de51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:27Z,use_quota=True,user_id='1dbd4c03067546dc9a13954090ef6c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Creating volume 4cb34cd0-63dc-4949-8878-d75331568362 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:35:26 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:35:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:26 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 1073741824 Jul 08 19:35:26 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:27 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 1073741824" returned: 0 in 1.027s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:27 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 Jul 08 19:35:27 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:28 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362" returned: 0 in 0.845s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962a4e69-3ad2-47e4-8a65-29e287ee174f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb34cd0-63dc-4949-8878-d75331568362', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd074013-231d-4c2a-bc63-0c29238a6307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:28 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Volume volume-4cb34cd0-63dc-4949-8878-d75331568362 (4cb34cd0-63dc-4949-8878-d75331568362): created successfully Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd074013-231d-4c2a-bc63-0c29238a6307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Flow 'volume_create_manager' (c021707c-9e6d-4a03-9fb8-be3c0ac8495e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:28 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6c2eebc1-ed21-4112-a58f-fcfefb16ae52 tempest-VolumesServicesTestJSON-1269007770 None] Created volume successfully. Jul 08 19:35:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Acquiring lock "cinder-4cb34cd0-63dc-4949-8878-d75331568362-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Lock "cinder-4cb34cd0-63dc-4949-8878-d75331568362-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Acquiring lock "cinder-quobyte-4cb34cd0-63dc-4949-8878-d75331568362" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Lock "cinder-quobyte-4cb34cd0-63dc-4949-8878-d75331568362" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bdad10-1d62-4110-966d-27996a559368]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:35:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:30 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 Jul 08 19:35:30 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:31 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362" returned: 0 in 0.939s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:31 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362 Jul 08 19:35:31 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:31 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4cb34cd0-63dc-4949-8878-d75331568362" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Lock "cinder-quobyte-4cb34cd0-63dc-4949-8878-d75331568362" released by "delete_volume" :: held 1.796s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:31 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Created reservations ['8dfd268d-f208-4a89-b83f-9880592fed04', 'dff93c82-eaed-4041-9ef9-42dc442a0fe9', 'f7e34c06-ec52-43d3-a973-daa4bbe35bc3', 'c6b2cdc0-a21d-48df-94e7-751978cef7c0'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:35:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:32 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:35:32 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:33 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.988s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:33 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:35:33 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Deleted volume successfully. Jul 08 19:35:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2e2ca2bb-eee8-4f33-ba6d-e9f99f9e2f7e tempest-VolumesServicesTestJSON-1269007770 None] Lock "cinder-4cb34cd0-63dc-4949-8878-d75331568362-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:34 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:35:34 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:35 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.792s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Flow 'volume_create_manager' (b1d7ebf7-7974-4387-a1a9-3fb3d58f2ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851b50f7-c5e7-4922-aaa6-bd56af116dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (851b50f7-c5e7-4922-aaa6-bd56af116dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-775229384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa394229-121a-4d67-b891-3456ed2c4aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef98cae76f24fb68df874382c5687b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:41Z,use_quota=True,user_id='e997acb8f3f544c0b8a34280c7bdd437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59400556-5cf3-482b-af0b-414c7007fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59400556-5cf3-482b-af0b-414c7007fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88884c3-add9-4f4e-9716-47d877c385f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88884c3-add9-4f4e-9716-47d877c385f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa394229-121a-4d67-b891-3456ed2c4aaa', 'volume_name': 'volume-fa394229-121a-4d67-b891-3456ed2c4aaa', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa912b0f-ae45-4b09-9665-e8d3af3eecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa912b0f-ae45-4b09-9665-e8d3af3eecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7239859-4612-45bc-b306-1e9953b729b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Volume fa394229-121a-4d67-b891-3456ed2c4aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa394229-121a-4d67-b891-3456ed2c4aaa', 'volume_size': 1} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-775229384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa394229-121a-4d67-b891-3456ed2c4aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef98cae76f24fb68df874382c5687b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:41Z,use_quota=True,user_id='e997acb8f3f544c0b8a34280c7bdd437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Creating volume fa394229-121a-4d67-b891-3456ed2c4aaa {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:35:41 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:35:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:41 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa 1073741824 Jul 08 19:35:41 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Flow 'volume_create_manager' (6f05909d-4e6c-4ba8-9254-f1de4335df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f3368f-0a40-44c8-b18c-d76bfe0d82c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f3368f-0a40-44c8-b18c-d76bfe0d82c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-127948737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a69525-2f95-4f1a-9056-eb3854331562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89d44be5bd41fbb82003f7e4524dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:42Z,use_quota=True,user_id='9c02a65bd54246758792b81b20f6c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5d34033-f6a1-4106-9f44-ea0a86104b6d),volume_type_id=d5d34033-f6a1-4106-9f44-ea0a86104b6d)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dc7cd7-10b9-4d38-bbbc-e4e084f02555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dc7cd7-10b9-4d38-bbbc-e4e084f02555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5191a620-c731-4ca1-a678-2c5b5a948e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5191a620-c731-4ca1-a678-2c5b5a948e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a69525-2f95-4f1a-9056-eb3854331562', 'volume_name': 'volume-d9a69525-2f95-4f1a-9056-eb3854331562', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0499b0f-a24c-497b-95b3-584073e2931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0499b0f-a24c-497b-95b3-584073e2931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd844069-3595-47b2-a2e8-ca696e4fb5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:42 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Volume d9a69525-2f95-4f1a-9056-eb3854331562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a69525-2f95-4f1a-9056-eb3854331562', 'volume_size': 1} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:42 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa 1073741824" returned: 0 in 1.236s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:42 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa Jul 08 19:35:42 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:43 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa" returned: 0 in 0.861s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-127948737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a69525-2f95-4f1a-9056-eb3854331562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e89d44be5bd41fbb82003f7e4524dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:42Z,use_quota=True,user_id='9c02a65bd54246758792b81b20f6c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5d34033-f6a1-4106-9f44-ea0a86104b6d),volume_type_id=d5d34033-f6a1-4106-9f44-ea0a86104b6d)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Creating volume d9a69525-2f95-4f1a-9056-eb3854331562 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:35:43 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:43 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 1073741824 Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7239859-4612-45bc-b306-1e9953b729b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa394229-121a-4d67-b891-3456ed2c4aaa', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:43 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b98a9a-a659-4504-840c-bb96ae6e27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:43 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Volume volume-fa394229-121a-4d67-b891-3456ed2c4aaa (fa394229-121a-4d67-b891-3456ed2c4aaa): created successfully Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b98a9a-a659-4504-840c-bb96ae6e27f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Flow 'volume_create_manager' (b1d7ebf7-7974-4387-a1a9-3fb3d58f2ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-72c1251b-4f36-4219-b605-f4d2e33bfec2 tempest-AttachVolumeShelveTestJSON-504353338 None] Created volume successfully. Jul 08 19:35:44 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 1073741824" returned: 0 in 1.074s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:44 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 Jul 08 19:35:44 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:46 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562" returned: 0 in 1.383s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd844069-3595-47b2-a2e8-ca696e4fb5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a69525-2f95-4f1a-9056-eb3854331562', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86c332-0591-4d1a-8e88-b5d5d3483696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Volume volume-d9a69525-2f95-4f1a-9056-eb3854331562 (d9a69525-2f95-4f1a-9056-eb3854331562): created successfully Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86c332-0591-4d1a-8e88-b5d5d3483696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Flow 'volume_create_manager' (6f05909d-4e6c-4ba8-9254-f1de4335df1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f39630af-22db-4e2d-8422-add049437169 tempest-VolumeTypesAccessTest-1575149481 None] Created volume successfully. Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Acquiring lock "cinder-d9a69525-2f95-4f1a-9056-eb3854331562-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Lock "cinder-d9a69525-2f95-4f1a-9056-eb3854331562-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Acquiring lock "cinder-quobyte-d9a69525-2f95-4f1a-9056-eb3854331562" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:35:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Lock "cinder-quobyte-d9a69525-2f95-4f1a-9056-eb3854331562" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:35:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[51069df9-82f7-4145-98e9-46f18352bd01]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:35:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:47 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 Jul 08 19:35:47 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:47 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562" returned: 0 in 0.926s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:48 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562 Jul 08 19:35:48 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:48 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d9a69525-2f95-4f1a-9056-eb3854331562" returned: 0 in 1.026s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Lock "cinder-quobyte-d9a69525-2f95-4f1a-9056-eb3854331562" released by "delete_volume" :: held 2.022s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:49 devstack cinder-volume[87172]: WARNING cinder.quota [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1488195162 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1488195162, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:35:49 devstack cinder-volume[87172]: WARNING cinder.quota [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1488195162 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1488195162, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Created reservations ['e6898597-01e1-4f24-984a-58277dd3b9cd', '533a8397-804b-4f56-b688-ba53c605d50d', '0147dd50-8c3a-45b0-9873-ed73083f3d04', '2f323074-95ad-431d-9524-01e9ce8cbf05'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:49 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:35:49 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:35:50 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Jul 08 19:35:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.279s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:35:50 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:35:50 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Deleted volume successfully. Jul 08 19:35:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0c4190c2-4a95-49b5-8c00-03444ef602d5 tempest-VolumeTypesAccessTest-1575149481 None] Lock "cinder-d9a69525-2f95-4f1a-9056-eb3854331562-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=18,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Flow 'volume_create_manager' (a8b61d9a-559d-48c8-b055-c7aa41f343c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d52be8-d842-47d0-8d36-a54bb456fdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d52be8-d842-47d0-8d36-a54bb456fdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1058063582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fae721-b859-454d-97d8-ba68a46848c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab92e043da24557b96805988a0ce90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:59Z,use_quota=True,user_id='f2e8ad77649748ba93ee769cd4957319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e538f8d7-a240-4ed2-9bbc-8e0a0692ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e538f8d7-a240-4ed2-9bbc-8e0a0692ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda68308-d21b-4a83-8cbd-d0801a3b13b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda68308-d21b-4a83-8cbd-d0801a3b13b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fae721-b859-454d-97d8-ba68a46848c7', 'volume_name': 'volume-a2fae721-b859-454d-97d8-ba68a46848c7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ca6218-f9dd-4f6f-9adc-e4584aa2d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ca6218-f9dd-4f6f-9adc-e4584aa2d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9146e8a3-aae3-49d5-9b06-8e6e2576a6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:35:59 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Volume a2fae721-b859-454d-97d8-ba68a46848c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fae721-b859-454d-97d8-ba68a46848c7', 'volume_size': 1} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1058063582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fae721-b859-454d-97d8-ba68a46848c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab92e043da24557b96805988a0ce90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:35:59Z,use_quota=True,user_id='f2e8ad77649748ba93ee769cd4957319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Creating volume a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:35:59 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:35:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:35:59 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 1073741824 Jul 08 19:35:59 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:00 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 1073741824" returned: 0 in 1.249s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:00 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 Jul 08 19:36:00 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:02 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7" returned: 0 in 1.230s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] <== create_volume: return (2577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9146e8a3-aae3-49d5-9b06-8e6e2576a6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fae721-b859-454d-97d8-ba68a46848c7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08198cd1-156c-497a-b23a-1b035a7295bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:02 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Volume volume-a2fae721-b859-454d-97d8-ba68a46848c7 (a2fae721-b859-454d-97d8-ba68a46848c7): created successfully Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08198cd1-156c-497a-b23a-1b035a7295bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Flow 'volume_create_manager' (a8b61d9a-559d-48c8-b055-c7aa41f343c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b3ec213b-2ba3-4eae-a35f-7414a141cd10 tempest-SnapshotMetadataTestJSON-2133833727 None] Created volume successfully. Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Creating offline snapshot 53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 of volume a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0481febf-c5ff-4a2a-b884-51fd32cea4d3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:03 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 Jul 08 19:36:03 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:04 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7" returned: 0 in 1.275s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:04 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 1G Jul 08 19:36:04 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-63b8a885-ce79-4a4e-aa1e-648b4b8ab655 req-c2b70408-de4a-48d5-8922-7d827de3efd0 tempest-AttachVolumeShelveTestJSON-504353338 None] No connector for attachment 26ba6566-cdea-4402-a2e9-feedb924e7ac; skipping storage backend terminate_connection call. {{(pid=87172) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5020}} Jul 08 19:36:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-63b8a885-ce79-4a4e-aa1e-648b4b8ab655 req-c2b70408-de4a-48d5-8922-7d827de3efd0 tempest-AttachVolumeShelveTestJSON-504353338 None] Deleting attachment 26ba6566-cdea-4402-a2e9-feedb924e7ac. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:36:05 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 1G" returned: 0 in 0.952s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fae721-b859-454d-97d8-ba68a46848c7 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:05 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fae721-b859-454d-97d8-ba68a46848c7 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 Jul 08 19:36:05 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:05 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fae721-b859-454d-97d8-ba68a46848c7 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:05 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 is being set with open permissions: ugo+rw Jul 08 19:36:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:05 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 Jul 08 19:36:05 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:06 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" returned: 0 in 0.935s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:07 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info Jul 08 19:36:07 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:08 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info" returned: 0 in 1.522s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:08 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info is being set with open permissions: ugo+rw Jul 08 19:36:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:08 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info Jul 08 19:36:08 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:10 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.info" returned: 0 in 1.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.390s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e65e7e96-901a-497c-850b-abc24c1b1f2d tempest-SnapshotMetadataTestJSON-2133833727 None] Create snapshot completed successfully Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "cinder-53fc0c9b-0b61-4031-bdb3-46ebaadaeca4-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-53fc0c9b-0b61-4031-bdb3-46ebaadaeca4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "cinder-quobyte-a2fae721-b859-454d-97d8-ba68a46848c7" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-quobyte-a2fae721-b859-454d-97d8-ba68a46848c7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "cinder-quobyte-53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-quobyte-53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Deleting offline snapshot 53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 of volume a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] snapshot_file for this snap is: volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a954a-1259-469b-bbd9-92247a446743]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:11 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 Jul 08 19:36:11 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:12 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" returned: 0 in 0.812s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2fae721-b859-454d-97d8-ba68a46848c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:36:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df3ff8d-ac9b-4da9-b196-94e4b4847b90]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:12 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 Jul 08 19:36:12 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:13 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7" returned: 0 in 0.748s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:13 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 Jul 08 19:36:13 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:14 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" returned: 0 in 0.833s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:14 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4 Jul 08 19:36:14 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:15 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7.53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" returned: 0 in 0.988s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-quobyte-53fc0c9b-0b61-4031-bdb3-46ebaadaeca4" released by "_delete_snapshot" :: held 3.537s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-quobyte-a2fae721-b859-454d-97d8-ba68a46848c7" released by "delete_snapshot" :: held 3.560s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Created reservations ['72c2fb99-7ef9-43f7-b810-241f4d60f10d', 'b7ac404a-4a83-4c75-a60e-cb3cf23ffb70', '7c111df3-f16c-4d22-8ee4-ecf127056aad', '4267a8db-0375-488c-b7eb-23ebf5e7ac2e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Delete snapshot completed successfully. Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1a333292-a3bc-4b8a-a680-78c3f6d25bd0 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-53fc0c9b-0b61-4031-bdb3-46ebaadaeca4-delete_snapshot" released by "delete_snapshot" :: held 3.817s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "cinder-a2fae721-b859-454d-97d8-ba68a46848c7-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-a2fae721-b859-454d-97d8-ba68a46848c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "cinder-quobyte-a2fae721-b859-454d-97d8-ba68a46848c7" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-quobyte-a2fae721-b859-454d-97d8-ba68a46848c7" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a6deb-1091-431b-943b-a48517d6447f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:16 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 Jul 08 19:36:16 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:17 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7" returned: 0 in 0.962s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:17 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7 Jul 08 19:36:17 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:18 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a2fae721-b859-454d-97d8-ba68a46848c7" returned: 0 in 1.188s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-quobyte-a2fae721-b859-454d-97d8-ba68a46848c7" released by "delete_volume" :: held 2.239s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Created reservations ['9d33121d-8037-47d3-97de-d04a0c9c74f5', '5ae46245-ee69-421d-bc11-d7a8d06708eb', '292dd577-93cd-45a0-845a-6f5919cf2215', 'ab470607-ce20-45b6-8959-bbe398090e95'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:18 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:36:18 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:20 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:20 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:36:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Deleted volume successfully. Jul 08 19:36:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-19fe278d-fb0d-4dbd-b078-023c52875e5e req-e8f56ccb-7c40-49b4-9609-2ca3c231cf9d tempest-AttachVolumeNegativeTest-2102385684 None] Terminate volume connection completed successfully. Jul 08 19:36:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-19fe278d-fb0d-4dbd-b078-023c52875e5e req-e8f56ccb-7c40-49b4-9609-2ca3c231cf9d tempest-AttachVolumeNegativeTest-2102385684 None] Deleting attachment 0d2d8602-05f9-42ed-afe3-c516d2285efb. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:36:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b5aa7cb-4bb6-4431-8f08-4d57d7902cc7 tempest-SnapshotMetadataTestJSON-2133833727 None] Lock "cinder-a2fae721-b859-454d-97d8-ba68a46848c7-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=29,cinder:UPDATE=53,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Flow 'volume_create_manager' (0be3827c-b8cc-4337-b313-96a3fe569cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc560839-2315-4547-84e2-428e1352ce05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc560839-2315-4547-84e2-428e1352ce05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-21808048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e8debd-4417-4646-bcf6-eb7fb9cfef66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73543c49a044df8a36bb8499ae0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:25Z,use_quota=True,user_id='80570b9b02c34c5daca862bf42a6d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e4241b-3adc-4f86-bbac-0587d56796fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e4241b-3adc-4f86-bbac-0587d56796fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10ccb8e-448e-43e7-a10e-81806f612ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10ccb8e-448e-43e7-a10e-81806f612ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e8debd-4417-4646-bcf6-eb7fb9cfef66', 'volume_name': 'volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe8e641-b0ee-4710-9fa0-2a2fbcbe5a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe8e641-b0ee-4710-9fa0-2a2fbcbe5a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7f30af-cdf4-4e36-ad19-43b5e7cedcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Volume b5e8debd-4417-4646-bcf6-eb7fb9cfef66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66', 'volume_size': 1} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-21808048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e8debd-4417-4646-bcf6-eb7fb9cfef66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73543c49a044df8a36bb8499ae0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:25Z,use_quota=True,user_id='80570b9b02c34c5daca862bf42a6d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Creating volume b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:36:24 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:36:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:24 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 1073741824 Jul 08 19:36:24 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:25 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 1073741824" returned: 0 in 1.251s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:26 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:26 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:26 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 0.939s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:36:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7f30af-cdf4-4e36-ad19-43b5e7cedcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed02a209-f299-498a-8634-52639c3924a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Volume volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 (b5e8debd-4417-4646-bcf6-eb7fb9cfef66): created successfully Jul 08 19:36:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed02a209-f299-498a-8634-52639c3924a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Flow 'volume_create_manager' (0be3827c-b8cc-4337-b313-96a3fe569cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-095e1c01-fb64-4e37-9a32-74d9f9eb45f6 tempest-VolumesDeleteCascade-2004549736 None] Created volume successfully. Jul 08 19:36:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Creating offline snapshot deafed47-049e-4a98-bf52-4aae5476b70c of volume b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce81b753-a78b-4062-ab92-a180550681cc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:28 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:28 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Flow 'volume_create_manager' (eb9d51ef-6c17-4552-afec-388c2d7fcc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cd49f5-71f5-4c22-acff-e5cd90d037e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cd49f5-71f5-4c22-acff-e5cd90d037e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1593439179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1b816d-4e27-4858-a4c3-535431a06d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33cc5a8b2f240cdb5efa8d6677e3aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:28Z,use_quota=True,user_id='310e05ffbdbf4f77b627312884ed655c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4970c9b-5c91-47b3-86f2-7416644ef4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4970c9b-5c91-47b3-86f2-7416644ef4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fd7a52-df1f-43f8-9624-22881538524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fd7a52-df1f-43f8-9624-22881538524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1b816d-4e27-4858-a4c3-535431a06d70', 'volume_name': 'volume-fb1b816d-4e27-4858-a4c3-535431a06d70', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebdcdb0-1b7b-4b00-b3b1-69ff6ce617f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebdcdb0-1b7b-4b00-b3b1-69ff6ce617f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e83f80a-60cd-4b33-9e0d-5c70db2ddb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:28 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Volume fb1b816d-4e27-4858-a4c3-535431a06d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1b816d-4e27-4858-a4c3-535431a06d70', 'volume_size': 1} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:28 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 0.838s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:28 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c 1G Jul 08 19:36:28 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:29 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c 1G" returned: 0 in 0.923s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:29 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:29 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:30 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.795s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:30 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c is being set with open permissions: ugo+rw Jul 08 19:36:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:30 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:30 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:31 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.695s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:31 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info Jul 08 19:36:31 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:32 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info" returned: 0 in 0.759s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:32 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info is being set with open permissions: ugo+rw Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:32 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info Jul 08 19:36:32 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:32 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.info" returned: 0 in 0.710s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.817s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.345s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1593439179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1b816d-4e27-4858-a4c3-535431a06d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33cc5a8b2f240cdb5efa8d6677e3aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:28Z,use_quota=True,user_id='310e05ffbdbf4f77b627312884ed655c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Creating volume fb1b816d-4e27-4858-a4c3-535431a06d70 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:36:32 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:36:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-359be004-395b-486b-986a-79c607ff6b05 tempest-VolumesDeleteCascade-2004549736 None] Create snapshot completed successfully Jul 08 19:36:32 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 1073741824 Jul 08 19:36:32 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:33 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 1073741824" returned: 0 in 0.978s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:33 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 Jul 08 19:36:33 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:34 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70" returned: 0 in 0.708s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.079s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e83f80a-60cd-4b33-9e0d-5c70db2ddb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1b816d-4e27-4858-a4c3-535431a06d70', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d49b54-596c-4d67-9bd4-03c21fcb3339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Creating offline snapshot e61036a4-0146-429c-a863-89ef2a75d55f of volume b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9892fcee-2b63-4867-9662-88e72ceb50de]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Volume volume-fb1b816d-4e27-4858-a4c3-535431a06d70 (fb1b816d-4e27-4858-a4c3-535431a06d70): created successfully Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d49b54-596c-4d67-9bd4-03c21fcb3339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Flow 'volume_create_manager' (eb9d51ef-6c17-4552-afec-388c2d7fcc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8e52cace-289b-46ce-8373-77ad56e70145 tempest-ServersNegativeTestJSON-336718391 None] Created volume successfully. Jul 08 19:36:34 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:36:34 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:34 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:34 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:35 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.908s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:35 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f 1G Jul 08 19:36:35 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:35 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.089s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:36:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:36:36 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f 1G" returned: 0 in 1.223s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:36 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f Jul 08 19:36:36 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:36 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Flow 'volume_create_manager' (7bec291b-f922-4f80-9373-e9fcca3ff8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6c7714-d128-40f3-bd27-e93bba4cbd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6c7714-d128-40f3-bd27-e93bba4cbd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-705642871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bab3286-f909-45b6-aa40-14700a17f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33cc5a8b2f240cdb5efa8d6677e3aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:37Z,use_quota=True,user_id='310e05ffbdbf4f77b627312884ed655c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6879f13a-9c00-49ab-8ebd-e5ed9055b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6879f13a-9c00-49ab-8ebd-e5ed9055b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c931d7-ff13-4b1b-ac15-abfaae4961f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c931d7-ff13-4b1b-ac15-abfaae4961f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bab3286-f909-45b6-aa40-14700a17f049', 'volume_name': 'volume-8bab3286-f909-45b6-aa40-14700a17f049', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d0bd3-9199-4fc2-8922-0fa70c89c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11d0bd3-9199-4fc2-8922-0fa70c89c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee205d2-1efa-4788-be00-29b9e5e06b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:37 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Volume 8bab3286-f909-45b6-aa40-14700a17f049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bab3286-f909-45b6-aa40-14700a17f049', 'volume_size': 1} Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:37 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f" returned: 0 in 0.797s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:37 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f is being set with open permissions: ugo+rw Jul 08 19:36:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:37 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f Jul 08 19:36:37 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:38 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f" returned: 0 in 0.647s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.760s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-705642871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bab3286-f909-45b6-aa40-14700a17f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33cc5a8b2f240cdb5efa8d6677e3aaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:37Z,use_quota=True,user_id='310e05ffbdbf4f77b627312884ed655c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Creating volume 8bab3286-f909-45b6-aa40-14700a17f049 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:36:38 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:38 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 1073741824 Jul 08 19:36:38 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:38 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-81ced8ae-a877-4a44-9317-9a2e8d6e19a4 tempest-VolumesDeleteCascade-2004549736 None] Create snapshot completed successfully Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-b5e8debd-4417-4646-bcf6-eb7fb9cfef66-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-b5e8debd-4417-4646-bcf6-eb7fb9cfef66-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Performing cascade delete. {{(pid=87172) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1005}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-deafed47-049e-4a98-bf52-4aae5476b70c-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-deafed47-049e-4a98-bf52-4aae5476b70c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-deafed47-049e-4a98-bf52-4aae5476b70c" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-deafed47-049e-4a98-bf52-4aae5476b70c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Deleting offline snapshot deafed47-049e-4a98-bf52-4aae5476b70c of volume b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:36:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] snapshot_file for this snap is: volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6eaa0d-d92d-4862-b3df-d99886c260e7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:39 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:39 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:39 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 1073741824" returned: 0 in 0.889s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:39 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 Jul 08 19:36:39 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:39 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.910s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3927f0f-a097-4a67-97c3-a8a1d0c83f9f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:40 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049" returned: 0 in 0.824s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee205d2-1efa-4788-be00-29b9e5e06b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bab3286-f909-45b6-aa40-14700a17f049', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d41fe8a-ca90-413e-9b62-2a0911a0c91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:40 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Volume volume-8bab3286-f909-45b6-aa40-14700a17f049 (8bab3286-f909-45b6-aa40-14700a17f049): created successfully Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d41fe8a-ca90-413e-9b62-2a0911a0c91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Flow 'volume_create_manager' (7bec291b-f922-4f80-9373-e9fcca3ff8b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:40 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:40 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1cfc095e-6c4e-4c6e-b00d-db2f389b06bd tempest-ServersNegativeTestJSON-336718391 None] Created volume successfully. Jul 08 19:36:41 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 1.164s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:41 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece28f2-3550-4092-8951-6866b6291ef8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:41 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f Jul 08 19:36:41 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "cinder-8bab3286-f909-45b6-aa40-14700a17f049-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-8bab3286-f909-45b6-aa40-14700a17f049-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "cinder-quobyte-8bab3286-f909-45b6-aa40-14700a17f049" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-quobyte-8bab3286-f909-45b6-aa40-14700a17f049" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08333cb-f4c9-4a6b-a1b4-075dc01f54ea]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:42 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 Jul 08 19:36:42 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:42 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f" returned: 0 in 1.120s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37a6b8a-1b92-40da-9704-a10fcba85543]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:42 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:42 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:43 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049" returned: 0 in 1.010s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:43 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049 Jul 08 19:36:43 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:43 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.859s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bff1e0-1dd6-47f2-b938-d05500ed9c30]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:43 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:43 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:43 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8bab3286-f909-45b6-aa40-14700a17f049" returned: 0 in 0.637s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-quobyte-8bab3286-f909-45b6-aa40-14700a17f049" released by "delete_volume" :: held 1.716s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Created reservations ['27833713-53e1-438f-bb68-7b927ebe12f4', '3e75a175-5e49-44c6-a61b-96880d7c81b9', '6d29a6eb-b6f9-4f9b-9a93-cc5ab115879e', 'cf6999cd-0775-49ef-8a89-05fe9d400aef'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:43 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:36:43 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:44 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 0.879s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:44 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:44 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "cinder-fb1b816d-4e27-4858-a4c3-535431a06d70-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-fb1b816d-4e27-4858-a4c3-535431a06d70-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "cinder-quobyte-fb1b816d-4e27-4858-a4c3-535431a06d70" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-quobyte-fb1b816d-4e27-4858-a4c3-535431a06d70" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[83012858-c3ca-4e43-8214-d209dcbeed13]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:44 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 Jul 08 19:36:44 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:44 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.820s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:36:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Deleted volume successfully. Jul 08 19:36:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-75e37d65-a2cc-4a41-82a4-c43482451ed3 tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-8bab3286-f909-45b6-aa40-14700a17f049-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:45 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.972s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:45 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c Jul 08 19:36:45 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:45 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70" returned: 0 in 0.855s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:45 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70 Jul 08 19:36:45 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:45 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.deafed47-049e-4a98-bf52-4aae5476b70c" returned: 0 in 0.673s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f -F qcow2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:45 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f -F qcow2 Jul 08 19:36:45 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:46 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fb1b816d-4e27-4858-a4c3-535431a06d70" returned: 0 in 0.679s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-quobyte-fb1b816d-4e27-4858-a4c3-535431a06d70" released by "delete_volume" :: held 1.601s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Created reservations ['bf0e1466-48ec-4f9e-8ca4-5bb8adc4f232', '7b80ad8d-37f9-4aea-be10-6cdd88bdcee4', 'bf8dcfad-08e1-494a-b02d-7203faead35f', 'a4afa8da-0200-4bb8-9aed-6d5a8809096c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:46 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:36:46 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:46 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f -F qcow2" returned: 0 in 1.127s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-deafed47-049e-4a98-bf52-4aae5476b70c" released by "_delete_snapshot" :: held 7.942s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" released by "delete_snapshot" :: held 7.975s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Created reservations ['83150b41-3a56-44b8-b0e4-6cfa21fc0c12', '3b43985d-1f4e-4ce1-b292-c7e246dfa9d7', 'a508f0a2-5dbd-4192-8f44-323fb8d5300d', 'ef3c83b3-eb57-46c7-aa99-e41159e1956b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:47 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Delete snapshot completed successfully. Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-deafed47-049e-4a98-bf52-4aae5476b70c-delete_snapshot" released by "delete_snapshot" :: held 8.243s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-e61036a4-0146-429c-a863-89ef2a75d55f-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-e61036a4-0146-429c-a863-89ef2a75d55f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:47 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.098s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:36:47 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Deleted volume successfully. Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-e61036a4-0146-429c-a863-89ef2a75d55f" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddc327dd-1c47-43f4-9bf6-a889a1193a6b tempest-ServersNegativeTestJSON-336718391 None] Lock "cinder-fb1b816d-4e27-4858-a4c3-535431a06d70-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-e61036a4-0146-429c-a863-89ef2a75d55f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Deleting offline snapshot e61036a4-0146-429c-a863-89ef2a75d55f of volume b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] snapshot_file for this snap is: volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[40caa29e-d76f-4407-a4d3-e6f81dad08f9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:47 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f Jul 08 19:36:47 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:48 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:36:48 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80285d5-db59-4fc0-9327-d5d4dec89943]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:48 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:48 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:49 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 1.362s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:49 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f Jul 08 19:36:49 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:50 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f" returned: 0 in 1.173s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:50 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f Jul 08 19:36:50 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:51 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66.e61036a4-0146-429c-a863-89ef2a75d55f" returned: 0 in 0.743s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-e61036a4-0146-429c-a863-89ef2a75d55f" released by "_delete_snapshot" :: held 4.301s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" released by "delete_snapshot" :: held 4.354s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Created reservations ['653e4579-5140-4e9e-a9f9-b4ae0dcdb83d', '0f1cad56-709a-4bc6-8363-c70abbeaf75a', 'e1ce63a8-5d3b-44b2-bfbd-3cb67b3ce760', 'cbad95aa-aa3c-46f9-8944-e9f4a7198097'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Delete snapshot completed successfully. Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-e61036a4-0146-429c-a863-89ef2a75d55f-delete_snapshot" released by "delete_snapshot" :: held 4.554s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Snapshots deleted, issuing volume delete {{(pid=87172) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1020}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4cb72-8fa4-4d49-b5ff-e88fb5a11503]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:51 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:51 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:53 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 1.410s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:53 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66 Jul 08 19:36:53 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:54 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" returned: 0 in 0.916s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-b5e8debd-4417-4646-bcf6-eb7fb9cfef66" released by "delete_volume" :: held 2.403s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Created reservations ['5708d363-6278-4583-a1e2-c000f3244536', 'e76db731-fdfe-4728-af4a-8852f9d6aa8f', 'cb851afd-1383-4f14-9f5c-3a1bebc25c58', 'ad5810d5-a36c-4b87-98b7-991bd3094414'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:54 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:36:54 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:55 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.755s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:36:55 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Deleted volume successfully. Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48083280-a4f6-426c-9a1c-88b1d8146830 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-b5e8debd-4417-4646-bcf6-eb7fb9cfef66-delete_volume" released by "delete_volume" :: held 16.377s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Flow 'volume_create_manager' (1d414e5d-eb4b-4d3d-a22e-79e4dca8e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c566b82-9b08-48f8-b395-b085e6e4bf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c566b82-9b08-48f8-b395-b085e6e4bf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1329019434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73543c49a044df8a36bb8499ae0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:55Z,use_quota=True,user_id='80570b9b02c34c5daca862bf42a6d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2d0fb-6463-4669-9326-2fa58c2647e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2d0fb-6463-4669-9326-2fa58c2647e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c542b9-d00b-41a6-bbc6-5d4ada3f3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c542b9-d00b-41a6-bbc6-5d4ada3f3b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4', 'volume_name': 'volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0259c241-e2b5-4355-920b-33ccf9ca5587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0259c241-e2b5-4355-920b-33ccf9ca5587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f17f5e-2dd0-4925-b77e-f3424722bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Volume c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4', 'volume_size': 1} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1329019434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73543c49a044df8a36bb8499ae0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:36:55Z,use_quota=True,user_id='80570b9b02c34c5daca862bf42a6d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Creating volume c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:36:55 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:36:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:55 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 1073741824 Jul 08 19:36:55 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:56 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 1073741824" returned: 0 in 1.109s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:56 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:36:56 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:57 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 1.096s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f17f5e-2dd0-4925-b77e-f3424722bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4c712e-a11a-407c-97a9-48a8b7add979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:36:57 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Volume volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 (c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4): created successfully Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4c712e-a11a-407c-97a9-48a8b7add979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:36:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Flow 'volume_create_manager' (1d414e5d-eb4b-4d3d-a22e-79e4dca8e53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:36:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0fafa966-0eee-408b-84d5-5f1778cfdfc8 tempest-VolumesDeleteCascade-2004549736 None] Created volume successfully. Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Acquiring lock "cinder-fa394229-121a-4d67-b891-3456ed2c4aaa-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "cinder-fa394229-121a-4d67-b891-3456ed2c4aaa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Creating offline snapshot df5a8e24-a078-438e-ade1-98b083622d25 of volume c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Acquiring lock "cinder-quobyte-fa394229-121a-4d67-b891-3456ed2c4aaa" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c6f35-6df1-4d0e-b560-dd3fe2a9eb6e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "cinder-quobyte-fa394229-121a-4d67-b891-3456ed2c4aaa" acquired by "delete_volume" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f43e7e-4893-44bf-bdec-a130f15fae6d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:36:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:36:59 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:36:59 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:36:59 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa Jul 08 19:36:59 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:00 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa" returned: 0 in 1.210s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:00 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 1.308s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:00 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa Jul 08 19:37:00 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:00 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 1G Jul 08 19:37:00 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:01 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fa394229-121a-4d67-b891-3456ed2c4aaa" returned: 0 in 0.737s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "cinder-quobyte-fa394229-121a-4d67-b891-3456ed2c4aaa" released by "delete_volume" :: held 2.015s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=65,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Created reservations ['38a2c1c8-7517-4a72-b385-b07ed282b333', 'e979f673-77ec-4800-aee4-b263e06ca85d', '9f1b7960-e7fd-41e5-81d9-6fac7194c514', '08243f30-c649-4167-b52c-51cacafe99b5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:01 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:01 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:01 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 1G" returned: 0 in 1.333s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:01 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 Jul 08 19:37:01 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:02 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.182s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:02 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Deleted volume successfully. Jul 08 19:37:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5b8f6f40-3bdd-4806-bf9a-5df155b89518 tempest-AttachVolumeShelveTestJSON-504353338 None] Lock "cinder-fa394229-121a-4d67-b891-3456ed2c4aaa-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:03 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25" returned: 0 in 1.123s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:03 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 is being set with open permissions: ugo+rw Jul 08 19:37:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:03 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 Jul 08 19:37:03 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:03 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25" returned: 0 in 0.825s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:03 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info Jul 08 19:37:03 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:04 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info" returned: 0 in 0.842s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:04 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info is being set with open permissions: ugo+rw Jul 08 19:37:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:04 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info Jul 08 19:37:04 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:05 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.info" returned: 0 in 0.868s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.437s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e174cea7-3fea-4196-b94b-76cbf3e554fe tempest-VolumesDeleteCascade-2004549736 None] Create snapshot completed successfully Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Flow 'volume_create_manager' (844ea236-6d8a-4d47-adfb-804f9f1302fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a225fa06-af51-4b98-991c-924f409f31f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a225fa06-af51-4b98-991c-924f409f31f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1603820211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132abc17-93c4-4de7-bdd6-225cf6d5b371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc73543c49a044df8a36bb8499ae0801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df5a8e24-a078-438e-ade1-98b083622d25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:07Z,use_quota=True,user_id='80570b9b02c34c5daca862bf42a6d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0d4c4f-0455-4249-8bf1-c4505437f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0d4c4f-0455-4249-8bf1-c4505437f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49644a8-497b-48a3-bdb4-1207583e5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49644a8-497b-48a3-bdb4-1207583e5600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '132abc17-93c4-4de7-bdd6-225cf6d5b371', 'volume_name': 'volume-132abc17-93c4-4de7-bdd6-225cf6d5b371', 'volume_size': 1, 'snapshot_id': 'df5a8e24-a078-438e-ade1-98b083622d25'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d96828-e67b-4332-980f-7706a1307b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d96828-e67b-4332-980f-7706a1307b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d32e213-196f-4b95-a28f-599d87899c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:07 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Volume 132abc17-93c4-4de7-bdd6-225cf6d5b371: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-132abc17-93c4-4de7-bdd6-225cf6d5b371', 'volume_size': 1, 'snapshot_id': 'df5a8e24-a078-438e-ade1-98b083622d25'} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-df5a8e24-a078-438e-ade1-98b083622d25-132abc17-93c4-4de7-bdd6-225cf6d5b371" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-df5a8e24-a078-438e-ade1-98b083622d25-132abc17-93c4-4de7-bdd6-225cf6d5b371" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Creating volume 132abc17-93c4-4de7-bdd6-225cf6d5b371 from snapshot df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-132abc17-93c4-4de7-bdd6-225cf6d5b371" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-132abc17-93c4-4de7-bdd6-225cf6d5b371" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] snapshot: df5a8e24-a078-438e-ade1-98b083622d25, volume: 132abc17-93c4-4de7-bdd6-225cf6d5b371, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df3262-8402-4571-a81f-9c2e14124bd6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:07 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 Jul 08 19:37:07 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:08 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25" returned: 0 in 1.078s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:37:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:37:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:37:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b27619f-a8cb-4c29-816b-062b71016496]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:08 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:37:08 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:09 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 1.246s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:09 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 Jul 08 19:37:09 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Flow 'volume_create_manager' (07a1994d-8141-4be9-89ce-388c4061ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1519140e-0c14-4b6a-8ca3-1a1775539206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1519140e-0c14-4b6a-8ca3-1a1775539206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1152863323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f0d40f-b4a7-4d7b-a636-232525e995f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a932f936d9a4c25a9fe9af694145ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:10Z,use_quota=True,user_id='851b633426f3485ea803de4d93d9abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8229b48a-ff8d-428a-9765-db26cafbeddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8229b48a-ff8d-428a-9765-db26cafbeddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4ecdff-2249-4579-a8c6-04a5a5008e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4ecdff-2249-4579-a8c6-04a5a5008e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f0d40f-b4a7-4d7b-a636-232525e995f9', 'volume_name': 'volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f0f2ab-2635-4f47-aae0-bc57ae755e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f0f2ab-2635-4f47-aae0-bc57ae755e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e9bb15-2f74-4679-bbde-b2721a1b8c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:09 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Volume b3f0d40f-b4a7-4d7b-a636-232525e995f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9', 'volume_size': 1} Jul 08 19:37:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:15 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371" returned: 0 in 5.920s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a284846-80d9-4c5b-8812-d4ccb6c884e2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Flow 'volume_create_manager' (4cd59d9e-91a7-4db4-b5a3-8d5d35300423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae61be2-ccef-43c4-8407-aee86c94acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:15 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:37:15 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae61be2-ccef-43c4-8407-aee86c94acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-317039259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfb9976-ab06-4d67-88b6-1a52719e5dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957addf5687f4194a8f14d436fa95ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:16Z,use_quota=True,user_id='f0e2ee46787a4de4a76c50d2c5a8591c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac204de3-eb1d-46b9-a368-62020d99e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac204de3-eb1d-46b9-a368-62020d99e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e8f948-c51e-41e0-be97-c44dbae42fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e8f948-c51e-41e0-be97-c44dbae42fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfb9976-ab06-4d67-88b6-1a52719e5dfc', 'volume_name': 'volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d923d13-0b58-4917-81e3-de986da6323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d923d13-0b58-4917-81e3-de986da6323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8d8a7d-d072-4cb9-8934-c9b11aabf816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Volume 3bfb9976-ab06-4d67-88b6-1a52719e5dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc', 'volume_size': 1} Jul 08 19:37:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:16 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 0.974s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:16 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:37:16 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Converted 1024.00 MB image at 172.95 MB/s Jul 08 19:37:16 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 is being set with open permissions: ugo+rw Jul 08 19:37:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:16 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 Jul 08 19:37:16 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:17 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371" returned: 0 in 0.617s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-132abc17-93c4-4de7-bdd6-225cf6d5b371" released by "_copy_volume_from_snapshot" :: held 9.948s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-df5a8e24-a078-438e-ade1-98b083622d25-132abc17-93c4-4de7-bdd6-225cf6d5b371" released by "_create_volume_from_snapshot" :: held 9.979s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.997s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.311s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1152863323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f0d40f-b4a7-4d7b-a636-232525e995f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a932f936d9a4c25a9fe9af694145ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:10Z,use_quota=True,user_id='851b633426f3485ea803de4d93d9abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Creating volume b3f0d40f-b4a7-4d7b-a636-232525e995f9 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:17 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:17 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 1073741824 Jul 08 19:37:17 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d32e213-196f-4b95-a28f-599d87899c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132abc17-93c4-4de7-bdd6-225cf6d5b371', 'volume_size': 1, 'snapshot_id': 'df5a8e24-a078-438e-ade1-98b083622d25'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32271de-2464-496d-b881-e14b3d7d7528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Volume volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 (132abc17-93c4-4de7-bdd6-225cf6d5b371): created successfully Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32271de-2464-496d-b881-e14b3d7d7528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Flow 'volume_create_manager' (844ea236-6d8a-4d47-adfb-804f9f1302fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-124fd19c-6e71-4021-9cf9-c76880255bfc tempest-VolumesDeleteCascade-2004549736 None] Created volume successfully. Jul 08 19:37:18 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 1073741824" returned: 0 in 0.982s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:18 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 Jul 08 19:37:18 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Performing cascade delete. {{(pid=87172) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1005}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-df5a8e24-a078-438e-ade1-98b083622d25-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-df5a8e24-a078-438e-ade1-98b083622d25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-df5a8e24-a078-438e-ade1-98b083622d25" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-df5a8e24-a078-438e-ade1-98b083622d25" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Deleting offline snapshot df5a8e24-a078-438e-ade1-98b083622d25 of volume c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] snapshot_file for this snap is: volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b47d6e-c29a-4a71-84a1-d9ec055e9bf8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:18 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 Jul 08 19:37:18 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:19 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9" returned: 0 in 0.815s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.326s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-317039259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfb9976-ab06-4d67-88b6-1a52719e5dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957addf5687f4194a8f14d436fa95ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:16Z,use_quota=True,user_id='f0e2ee46787a4de4a76c50d2c5a8591c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Creating volume 3bfb9976-ab06-4d67-88b6-1a52719e5dfc {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:19 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:19 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc 1073741824 Jul 08 19:37:19 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e9bb15-2f74-4679-bbde-b2721a1b8c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb087b3c-2f8a-46fb-aacf-d20e002e831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Volume volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 (b3f0d40f-b4a7-4d7b-a636-232525e995f9): created successfully Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb087b3c-2f8a-46fb-aacf-d20e002e831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Flow 'volume_create_manager' (07a1994d-8141-4be9-89ce-388c4061ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-875b1288-681e-4429-9260-48bcf10f3d76 tempest-VolumesTestJSON-57714238 None] Created volume successfully. Jul 08 19:37:19 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25" returned: 0 in 0.957s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0535b417-1129-4015-958b-cfd1afab5fae]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:19 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:37:19 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:20 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc 1073741824" returned: 0 in 1.028s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:20 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc Jul 08 19:37:20 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:20 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Flow 'volume_create_manager' (e5acfcc2-b133-4799-a88b-b41632eaa21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2e9536-ce06-4647-a6ea-1c9d8353bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 1.072s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2e9536-ce06-4647-a6ea-1c9d8353bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1340088357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939d2605-83b8-4e57-9fab-d7a12523cf67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a932f936d9a4c25a9fe9af694145ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:20Z,use_quota=True,user_id='851b633426f3485ea803de4d93d9abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6a2d81-eef3-4208-8831-5ebfe3968e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:20 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6a2d81-eef3-4208-8831-5ebfe3968e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:20 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b198bbe-9f43-4e41-8e58-416e32a30030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b198bbe-9f43-4e41-8e58-416e32a30030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939d2605-83b8-4e57-9fab-d7a12523cf67', 'volume_name': 'volume-939d2605-83b8-4e57-9fab-d7a12523cf67', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede9d6f5-2896-4436-b3dd-741067ebe483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede9d6f5-2896-4436-b3dd-741067ebe483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ce46b-a528-4be0-9495-29643f1784e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Volume 939d2605-83b8-4e57-9fab-d7a12523cf67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939d2605-83b8-4e57-9fab-d7a12523cf67', 'volume_size': 1} Jul 08 19:37:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:21 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1340088357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939d2605-83b8-4e57-9fab-d7a12523cf67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a932f936d9a4c25a9fe9af694145ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:20Z,use_quota=True,user_id='851b633426f3485ea803de4d93d9abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Creating volume 939d2605-83b8-4e57-9fab-d7a12523cf67 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:21 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8d8a7d-d072-4cb9-8934-c9b11aabf816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:21 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 1073741824 Jul 08 19:37:21 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8a9225-e040-427f-aff3-2443f53bd0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Volume volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc (3bfb9976-ab06-4d67-88b6-1a52719e5dfc): created successfully Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8a9225-e040-427f-aff3-2443f53bd0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Flow 'volume_create_manager' (4cd59d9e-91a7-4db4-b5a3-8d5d35300423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a829e245-f2f2-4f49-9c19-784ca659e620 tempest-AttachVolumeNegativeTest-2102385684 None] Created volume successfully. Jul 08 19:37:21 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25" returned: 0 in 0.786s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:21 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25 Jul 08 19:37:21 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:22 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 1073741824" returned: 0 in 0.950s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:22 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 Jul 08 19:37:22 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:22 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4.df5a8e24-a078-438e-ade1-98b083622d25" returned: 0 in 0.707s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-df5a8e24-a078-438e-ade1-98b083622d25" released by "_delete_snapshot" :: held 3.652s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" released by "delete_snapshot" :: held 3.684s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Created reservations ['890301fd-a3cc-489a-b773-1fca91d35f15', 'd7c61d30-862c-4be1-92c1-b6fe0fec5178', 'e31bc4d8-b305-4794-87ea-15cd0d0f3330', '55ce8cfd-bfdc-4a44-aa56-82ac7c541305'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Delete snapshot completed successfully. Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-df5a8e24-a078-438e-ade1-98b083622d25-delete_snapshot" released by "delete_snapshot" :: held 3.863s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Snapshots deleted, issuing volume delete {{(pid=87172) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1020}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d58b2-e665-4578-87ef-56e21f6b2f66]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:22 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:37:22 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:22 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67" returned: 0 in 0.809s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa8ce46b-a528-4be0-9495-29643f1784e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939d2605-83b8-4e57-9fab-d7a12523cf67', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47f1cd8-0568-412c-8f99-840ea63a0a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Volume volume-939d2605-83b8-4e57-9fab-d7a12523cf67 (939d2605-83b8-4e57-9fab-d7a12523cf67): created successfully Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47f1cd8-0568-412c-8f99-840ea63a0a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Flow 'volume_create_manager' (e5acfcc2-b133-4799-a88b-b41632eaa21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e995bce8-48f2-4b0b-a9b8-8039cd7e81bf tempest-VolumesTestJSON-57714238 None] Created volume successfully. Jul 08 19:37:23 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 0.909s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:23 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4 Jul 08 19:37:23 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:23 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" returned: 0 in 0.720s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4" released by "delete_volume" :: held 1.701s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Created reservations ['e5e76688-1666-47cd-b005-489add51d289', 'a6fa3183-4d68-40f9-b893-70d9040a0aad', '43bee6a9-716f-40e3-ba4e-db83c1ffc4d0', 'f68e1aa9-a905-44ef-b0d8-6c21fb7b5c7a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:24 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:24 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Flow 'volume_create_manager' (f7bcb909-6115-4409-adab-bec1dedcb06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f03658-aa29-4767-9cd8-891dae0a4d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f03658-aa29-4767-9cd8-891dae0a4d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-325411232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36708cf2-a635-4cb8-a61f-3080dec1960e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a932f936d9a4c25a9fe9af694145ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:24Z,use_quota=True,user_id='851b633426f3485ea803de4d93d9abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd5ddbb-d922-4d6d-9143-3d600a53d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd5ddbb-d922-4d6d-9143-3d600a53d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b6fa34-87b8-48f4-a2f3-430d42adac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b6fa34-87b8-48f4-a2f3-430d42adac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36708cf2-a635-4cb8-a61f-3080dec1960e', 'volume_name': 'volume-36708cf2-a635-4cb8-a61f-3080dec1960e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f4750a-963d-40f9-9302-22e53106a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f4750a-963d-40f9-9302-22e53106a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6f0e5d-e179-41b5-95a4-589cbf1ff850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Volume 36708cf2-a635-4cb8-a61f-3080dec1960e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36708cf2-a635-4cb8-a61f-3080dec1960e', 'volume_size': 1} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-325411232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36708cf2-a635-4cb8-a61f-3080dec1960e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a932f936d9a4c25a9fe9af694145ae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:24Z,use_quota=True,user_id='851b633426f3485ea803de4d93d9abcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Creating volume 36708cf2-a635-4cb8-a61f-3080dec1960e {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:24 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:24 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e 1073741824 Jul 08 19:37:24 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:24 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Deleted volume successfully. Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=6,cinder:SELECT=71 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e094dbb7-b8ee-431a-948f-474137f6c88e tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-c4a0177b-516e-4e4e-ba0b-5fd5f6270fb4-delete_volume" released by "delete_volume" :: held 6.690s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-132abc17-93c4-4de7-bdd6-225cf6d5b371-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-132abc17-93c4-4de7-bdd6-225cf6d5b371-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "cinder-quobyte-132abc17-93c4-4de7-bdd6-225cf6d5b371" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-132abc17-93c4-4de7-bdd6-225cf6d5b371" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[57812689-cf5b-4f6f-9704-18910781989d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:25 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 Jul 08 19:37:25 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:25 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e 1073741824" returned: 0 in 1.025s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:25 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e Jul 08 19:37:25 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:26 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371" returned: 0 in 0.871s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:26 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371 Jul 08 19:37:26 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:26 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e" returned: 0 in 0.737s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.897s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6f0e5d-e179-41b5-95a4-589cbf1ff850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36708cf2-a635-4cb8-a61f-3080dec1960e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47178fa3-0f17-43fa-be58-05610b6ca655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f193241-9075-40fb-8ee1-cc5ade7dbc50]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Volume volume-36708cf2-a635-4cb8-a61f-3080dec1960e (36708cf2-a635-4cb8-a61f-3080dec1960e): created successfully Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47178fa3-0f17-43fa-be58-05610b6ca655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Flow 'volume_create_manager' (f7bcb909-6115-4409-adab-bec1dedcb06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-636388a9-877d-436e-810c-f9cab87dd2b0 tempest-VolumesTestJSON-57714238 None] Created volume successfully. Jul 08 19:37:26 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc Jul 08 19:37:26 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:26 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-132abc17-93c4-4de7-bdd6-225cf6d5b371" returned: 0 in 0.767s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-quobyte-132abc17-93c4-4de7-bdd6-225cf6d5b371" released by "delete_volume" :: held 1.698s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Created reservations ['6e36ecbb-0969-4352-ae29-0f9966a88551', '70a6a7a8-3910-444f-87d6-14e58e976ca8', '4c83ba59-4320-49d9-803a-711f9351fde4', 'd8214023-54b7-4ade-9b0c-f294c9d76e3f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:27 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:27 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:27 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" returned: 0 in 1.132s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.171s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d7f1f8e-4b03-4b90-95fd-ee7564938c51', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:37:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-62715961-ff37-4a23-9b93-1055db40c21b req-54555e44-8d37-402b-8966-f26a19dc91ef tempest-AttachVolumeNegativeTest-2102385684 None] attachment_update completed successfully. Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "cinder-36708cf2-a635-4cb8-a61f-3080dec1960e-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-36708cf2-a635-4cb8-a61f-3080dec1960e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "cinder-quobyte-36708cf2-a635-4cb8-a61f-3080dec1960e" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-quobyte-36708cf2-a635-4cb8-a61f-3080dec1960e" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[95413395-5083-412c-b10d-0f818d39ccf9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:28 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e Jul 08 19:37:28 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:28 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.316s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:28 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Deleted volume successfully. Jul 08 19:37:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00b7632f-c964-4886-8d63-814831b50632 tempest-VolumesDeleteCascade-2004549736 None] Lock "cinder-132abc17-93c4-4de7-bdd6-225cf6d5b371-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:29 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e" returned: 0 in 1.253s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:29 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e Jul 08 19:37:29 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:30 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36708cf2-a635-4cb8-a61f-3080dec1960e" returned: 0 in 0.827s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-quobyte-36708cf2-a635-4cb8-a61f-3080dec1960e" released by "delete_volume" :: held 2.189s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Created reservations ['c1a38b52-a222-4d34-8701-2ad0e82c3e40', 'e0bdec82-147e-456b-8815-1dd4788b1f34', '5d72cc78-731a-4293-a0bb-9774ceecf04f', 'c198da92-c705-4ab5-aa41-63cb475367be'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:30 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:30 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:31 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.678s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:31 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Deleted volume successfully. Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a5262d3c-2b5e-489d-8a07-7b695be1a2b0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-36708cf2-a635-4cb8-a61f-3080dec1960e-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Acquiring lock "cinder-939d2605-83b8-4e57-9fab-d7a12523cf67-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Lock "cinder-939d2605-83b8-4e57-9fab-d7a12523cf67-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Acquiring lock "cinder-quobyte-939d2605-83b8-4e57-9fab-d7a12523cf67" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Lock "cinder-quobyte-939d2605-83b8-4e57-9fab-d7a12523cf67" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c357236-fbad-4a90-8125-d95b8639c1fd]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:31 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 Jul 08 19:37:31 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Flow 'volume_create_manager' (198d7bba-f899-4319-a3b1-91451e38a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837d67f6-8caa-4159-b7e1-3b7595cfd745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837d67f6-8caa-4159-b7e1-3b7595cfd745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-358095485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3588bc069e4d98a19b6846d8d709bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:32Z,use_quota=True,user_id='bf5e74121f5e495db4780728b84e1494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f14856-c4ea-43b2-94a5-08063fd8acfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f14856-c4ea-43b2-94a5-08063fd8acfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d55ac2-b3b7-44ad-839a-5a3c9a864874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d55ac2-b3b7-44ad-839a-5a3c9a864874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447', 'volume_name': 'volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447', 'volume_size': 2}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f417b51e-d212-4485-b636-215e1d3f350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f417b51e-d212-4485-b636-215e1d3f350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a522490b-7056-4fab-8762-5af607ce4472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Volume aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447', 'volume_size': 2} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-358095485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a3588bc069e4d98a19b6846d8d709bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:32Z,use_quota=True,user_id='bf5e74121f5e495db4780728b84e1494',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Creating volume aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:31 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:37:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 2147483648 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:31 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 2147483648 Jul 08 19:37:31 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:32 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:32 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67 Jul 08 19:37:32 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:32 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-939d2605-83b8-4e57-9fab-d7a12523cf67" returned: 0 in 0.695s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Lock "cinder-quobyte-939d2605-83b8-4e57-9fab-d7a12523cf67" released by "delete_volume" :: held 1.634s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:32 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 2147483648" returned: 0 in 1.108s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Created reservations ['066503b5-944a-4145-b138-4089f5a6e184', 'c52f7de3-c835-4d19-9839-953bf3d08d29', 'fb481d1e-86f8-432a-a05f-420bdb06e8f4', 'edd7bb37-1375-47f1-84f9-4c119929d110'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:33 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 Jul 08 19:37:33 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:33 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:33 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "cinder-b3f0d40f-b4a7-4d7b-a636-232525e995f9-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-b3f0d40f-b4a7-4d7b-a636-232525e995f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "cinder-quobyte-b3f0d40f-b4a7-4d7b-a636-232525e995f9" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-quobyte-b3f0d40f-b4a7-4d7b-a636-232525e995f9" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f74446-bcf3-46a6-abee-ec4f374c02f3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:33 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 Jul 08 19:37:33 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:34 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447" returned: 0 in 0.985s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a522490b-7056-4fab-8762-5af607ce4472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447', 'volume_size': 2}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295d1f4c-cc0b-4e75-bd1c-59760a9c6bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Volume volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 (aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447): created successfully Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295d1f4c-cc0b-4e75-bd1c-59760a9c6bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Flow 'volume_create_manager' (198d7bba-f899-4319-a3b1-91451e38a218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-40e91733-b629-4ff2-8069-bc64959ce6db tempest-VolumesCloneNegativeTest-269601609 None] Created volume successfully. Jul 08 19:37:34 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.163s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Deleted volume successfully. Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1c17b0f2-22f6-48ff-87d5-7810b46bd910 tempest-VolumesTestJSON-57714238 None] Lock "cinder-939d2605-83b8-4e57-9fab-d7a12523cf67-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-757d01e6-9907-43da-9da7-1bf015da7a43 req-d2529c27-222a-48b0-984b-145495386007 tempest-AttachVolumeNegativeTest-2102385684 None] Terminate volume connection completed successfully. Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-757d01e6-9907-43da-9da7-1bf015da7a43 req-d2529c27-222a-48b0-984b-145495386007 tempest-AttachVolumeNegativeTest-2102385684 None] Deleting attachment 0d7f1f8e-4b03-4b90-95fd-ee7564938c51. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:34 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:34 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:34 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9" returned: 0 in 1.093s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:34 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9 Jul 08 19:37:34 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Acquiring lock "cinder-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Lock "cinder-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Acquiring lock "cinder-quobyte-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Lock "cinder-quobyte-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda2e27-8664-4587-acde-931e336ba5f4]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:35 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.792s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:37:35 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 Jul 08 19:37:35 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:35 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f0d40f-b4a7-4d7b-a636-232525e995f9" returned: 0 in 0.801s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-quobyte-b3f0d40f-b4a7-4d7b-a636-232525e995f9" released by "delete_volume" :: held 1.989s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Created reservations ['6902eef2-f640-4a81-8794-d35f83a80848', 'cc89a9a4-210c-4de4-a829-46fea004c633', 'ae29a875-dbac-4bce-a59b-628c7f448e79', 'f19f9db9-5d4a-47cc-b3a3-96d9997d8ac5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:35 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:35 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:36 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447" returned: 0 in 0.904s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:36 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447 Jul 08 19:37:36 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:36 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.752s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:36 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Deleted volume successfully. Jul 08 19:37:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-356669c1-4a73-4107-8c72-f5680c792dd0 tempest-VolumesTestJSON-57714238 None] Lock "cinder-b3f0d40f-b4a7-4d7b-a636-232525e995f9-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:37 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447" returned: 0 in 0.836s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Lock "cinder-quobyte-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447" released by "delete_volume" :: held 1.808s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Created reservations ['d587d32d-2987-47d4-b2a2-d483ea7b46aa', 'd5eac797-cf97-4975-87e4-47224d852b3d', 'a7e98d8f-10ca-4af7-b253-41a8977632db', 'e44486f3-657b-48dc-a5f1-05f18e75e4b9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:37 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:37:37 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:38 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.986s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:38 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:37:38 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Deleted volume successfully. Jul 08 19:37:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5a40123-e9a5-495c-8269-a536e5b2019f tempest-VolumesCloneNegativeTest-269601609 None] Lock "cinder-aa44a6d9-62aa-4ef2-aa34-cdd7aa1e1447-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Flow 'volume_create_manager' (15fdb575-5170-4d8a-b59b-90d4d5b27a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88434a12-d86b-4c6e-9f60-01011379c2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88434a12-d86b-4c6e-9f60-01011379c2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-150156110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7e56c-27e2-4db4-91d5-721ab3b707ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70c52e031f14642ac261da8816e15d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:46Z,use_quota=True,user_id='528ed39547ef478bb3a5fdb7cc2c3a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0016b7aa-dc75-4df3-adeb-fb85c3e5afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0016b7aa-dc75-4df3-adeb-fb85c3e5afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7354f33-5523-4d4a-8ae7-c53212d39b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7354f33-5523-4d4a-8ae7-c53212d39b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d7e56c-27e2-4db4-91d5-721ab3b707ac', 'volume_name': 'volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6089607-c93e-40f1-b83a-ad6a175f9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6089607-c93e-40f1-b83a-ad6a175f9488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbaff5a-63d0-4181-bd86-b4e5458795d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac', 'volume_size': 1} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-150156110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7e56c-27e2-4db4-91d5-721ab3b707ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70c52e031f14642ac261da8816e15d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:37:46Z,use_quota=True,user_id='528ed39547ef478bb3a5fdb7cc2c3a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Creating volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:37:46 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:37:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:46 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac 1073741824 Jul 08 19:37:46 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:47 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac 1073741824" returned: 0 in 1.347s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:47 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac Jul 08 19:37:47 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:48 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbaff5a-63d0-4181-bd86-b4e5458795d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d281821-1a28-4a89-9893-eb39c88a5880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:37:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Volume volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac (91d7e56c-27e2-4db4-91d5-721ab3b707ac): created successfully Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d281821-1a28-4a89-9893-eb39c88a5880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:37:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Flow 'volume_create_manager' (15fdb575-5170-4d8a-b59b-90d4d5b27a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:37:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8882210d-1f6b-4581-9cea-ddb82cf3482d tempest-VolumesSnapshotListTestJSON-1152037582 None] Created volume successfully. Jul 08 19:37:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Creating offline snapshot a700585a-ae13-4d06-a48d-4c3bb2d9fd4b of volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:37:49 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34a1f22-512c-4bcd-9c6c-a38c997c65dd]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-de11e83e-9cdb-4d6b-a5a2-7e3f4d5920fb tempest-BackendsCapabilitiesAdminTestsJSON-1244492808 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87172) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4840}} Jul 08 19:37:50 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac Jul 08 19:37:50 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef23eb7b-65bc-4699-a172-e9e5d1d7e18b tempest-BackendsCapabilitiesAdminTestsJSON-1244492808 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87172) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4840}} Jul 08 19:37:50 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac" returned: 0 in 0.802s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:50 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b 1G Jul 08 19:37:50 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:51 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b 1G" returned: 0 in 0.841s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:51 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:37:51 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:52 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 0.797s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:52 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b is being set with open permissions: ugo+rw Jul 08 19:37:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:52 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:37:52 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:53 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 0.689s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:53 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info Jul 08 19:37:53 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:53 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info" returned: 0 in 0.765s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:53 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info is being set with open permissions: ugo+rw Jul 08 19:37:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:53 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info Jul 08 19:37:53 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:54 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.info" returned: 0 in 0.678s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.675s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4b0689fb-1ea0-4004-b47a-462e47ea4a74 tempest-VolumesSnapshotListTestJSON-1152037582 None] Create snapshot completed successfully Jul 08 19:37:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Creating offline snapshot 6b0400ce-8e89-4780-9f0a-e02ecbdca327 of volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:37:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e5a68-20a1-448e-9686-758a4c63272c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:55 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:37:55 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:56 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 1.179s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:37:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:56 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 1G Jul 08 19:37:56 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:57 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 1G" returned: 0 in 1.205s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:57 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:37:57 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:58 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:58 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 is being set with open permissions: ugo+rw Jul 08 19:37:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:37:58 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:37:58 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:37:59 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 0.689s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.944s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:37:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0255eab3-78aa-4afe-bd98-2cfea071f462 tempest-VolumesSnapshotListTestJSON-1152037582 None] Create snapshot completed successfully Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Creating offline snapshot 1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 of volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e558b6-f329-4ba4-883d-b0b0fce0ed4c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:37:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:00 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:38:00 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:00 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 0.856s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:38:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:00 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 1G Jul 08 19:38:00 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:01 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 1G" returned: 0 in 1.221s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:02 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 Jul 08 19:38:02 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a7c715fc-4711-4ac2-8d86-c1069e7b692a tempest-GroupsV320Test-38283322 None] Group tempest-GroupsV320Test-Group-1280074527: creating Jul 08 19:38:02 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=87,cinder:SELECT=68,cinder:DELETE=12,cinder:INSERT=20 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:38:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a7c715fc-4711-4ac2-8d86-c1069e7b692a tempest-GroupsV320Test-38283322 None] Group tempest-GroupsV320Test-Group-1280074527: created successfully Jul 08 19:38:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a7c715fc-4711-4ac2-8d86-c1069e7b692a tempest-GroupsV320Test-38283322 None] Create group completed successfully. Jul 08 19:38:02 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" returned: 0 in 0.783s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:02 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 is being set with open permissions: ugo+rw Jul 08 19:38:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:02 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 Jul 08 19:38:02 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Flow 'volume_create_manager' (72ba6bbc-620b-4ba4-ba00-50a0ce85b79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de917cc-6d35-4422-9bac-e655bb383a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de917cc-6d35-4422-9bac-e655bb383a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830486831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4129e84f-e6bf-4074-ad30-aff81c2c6b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b7724124ce4a5ba12807f161946bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:38:03Z,use_quota=True,user_id='b69ebdfe6cab49fba920a0014f8df6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f5b8d-ae7a-4d44-80c1-e6dc52bef6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f5b8d-ae7a-4d44-80c1-e6dc52bef6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eef74cb-3eee-4c9e-9fe7-5bbe7a93559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eef74cb-3eee-4c9e-9fe7-5bbe7a93559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4129e84f-e6bf-4074-ad30-aff81c2c6b4c', 'volume_name': 'volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589c0cd4-8d13-4ad0-a84b-2688404b51b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589c0cd4-8d13-4ad0-a84b-2688404b51b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4508dff7-e958-40b0-bdc6-c96fc7ff7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:03 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Volume 4129e84f-e6bf-4074-ad30-aff81c2c6b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c', 'volume_size': 1} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:03 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" returned: 0 in 0.734s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.715s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830486831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4129e84f-e6bf-4074-ad30-aff81c2c6b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b7724124ce4a5ba12807f161946bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:38:03Z,use_quota=True,user_id='b69ebdfe6cab49fba920a0014f8df6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Creating volume 4129e84f-e6bf-4074-ad30-aff81c2c6b4c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:38:03 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:38:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:03 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c 1073741824 Jul 08 19:38:03 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f79e1d62-8d32-4b94-8755-89b9a118e225 tempest-VolumesSnapshotListTestJSON-1152037582 None] Create snapshot completed successfully Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Created reservations ['b5cfa84e-ed83-4a0d-9502-5bb346f0398b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:04 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:38:04 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:04 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c 1073741824" returned: 0 in 1.204s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:04 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c Jul 08 19:38:04 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:05 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.000s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:38:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1f88c56f-0588-43f4-9840-b38cb696ffcb tempest-GroupsV320Test-38283322 None] Delete group completed successfully. Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Deleting offline snapshot 1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 of volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] snapshot_file for this snap is: volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e44cd8-7776-46a5-9836-22cd64b3e16d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:05 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" returned: 0 in 1.093s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4508dff7-e958-40b0-bdc6-c96fc7ff7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29f4c92-e212-4756-9ee0-62541f8816bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Volume volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c (4129e84f-e6bf-4074-ad30-aff81c2c6b4c): created successfully Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29f4c92-e212-4756-9ee0-62541f8816bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Flow 'volume_create_manager' (72ba6bbc-620b-4ba4-ba00-50a0ce85b79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:38:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f085d03b-ca1a-40c1-a9da-4c01d49e81ff tempest-AttachVolumeTestJSON-688216625 None] Created volume successfully. Jul 08 19:38:06 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 Jul 08 19:38:06 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:07 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" returned: 0 in 1.206s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:38:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe0775-9d64-4392-be81-7ed50bf560b2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:07 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:38:07 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:08 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 1.110s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:38:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:08 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 Jul 08 19:38:08 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:09 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" returned: 0 in 1.140s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:09 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7 Jul 08 19:38:09 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:10 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" returned: 0 in 0.835s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7" released by "_delete_snapshot" :: held 4.482s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" released by "delete_snapshot" :: held 4.524s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Created reservations ['6eb94539-6480-44da-b903-fc8c0692fa4a', '56b22c9e-5191-4e42-ba12-8dcfef3bdef9', '35551ce4-90d3-4d8e-b750-96286d1fda15', 'f7a3b081-abcb-4460-9a1d-a93fb53c33f3'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de82ee-da9b-4e0d-880e-80dca45b606e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Delete snapshot completed successfully. Jul 08 19:38:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c430ed6-c6e0-4719-9c48-35d92a6bb564 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-1ed0c16d-1fbe-4a03-9f76-f96cccc51bc7-delete_snapshot" released by "delete_snapshot" :: held 4.820s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:10 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c Jul 08 19:38:10 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-6b0400ce-8e89-4780-9f0a-e02ecbdca327-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-6b0400ce-8e89-4780-9f0a-e02ecbdca327-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-6b0400ce-8e89-4780-9f0a-e02ecbdca327" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-6b0400ce-8e89-4780-9f0a-e02ecbdca327" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Deleting offline snapshot 6b0400ce-8e89-4780-9f0a-e02ecbdca327 of volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] snapshot_file for this snap is: volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7946aa-c402-40a9-8722-92a286a76c21]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:11 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" returned: 0 in 0.911s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:11 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:38:11 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4ca14ed-1b2e-4d6a-bb13-294445c987d4', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:38:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-15f6846a-d3fb-49fb-a42c-c1c5ce195ae5 req-73d56e12-041c-40f6-8edb-8ad51fe85468 tempest-AttachVolumeTestJSON-688216625 None] attachment_update completed successfully. Jul 08 19:38:12 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 0.953s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:38:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e657ec88-0fb2-4db3-aa41-17be7fb7bb8b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:12 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:38:12 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:13 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 0.997s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:38:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:13 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:38:13 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:14 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 0.846s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:14 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327 Jul 08 19:38:14 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:14 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.6b0400ce-8e89-4780-9f0a-e02ecbdca327" returned: 0 in 0.779s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-6b0400ce-8e89-4780-9f0a-e02ecbdca327" released by "_delete_snapshot" :: held 3.716s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" released by "delete_snapshot" :: held 3.749s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:14 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Created reservations ['d091d914-658a-4397-8e38-800ff365d380', 'c8c6d4ba-6abf-4338-8cdf-742a7072372a', '9fe01b7e-5243-44c1-b40d-784639c92b81', '4ba525a4-b381-4b08-a018-837cf09dd4d0'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:38:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Delete snapshot completed successfully. Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dfc5bcc-e125-457e-985c-192f1d603b92 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-6b0400ce-8e89-4780-9f0a-e02ecbdca327-delete_snapshot" released by "delete_snapshot" :: held 3.920s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-a700585a-ae13-4d06-a48d-4c3bb2d9fd4b-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-a700585a-ae13-4d06-a48d-4c3bb2d9fd4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Deleting offline snapshot a700585a-ae13-4d06-a48d-4c3bb2d9fd4b of volume 91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] snapshot_file for this snap is: volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a37c6-aa98-4e87-aa23-7bc5b92b3be5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:15 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:38:15 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:16 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 1.106s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:38:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[02efa0f0-407a-47b6-a6f5-a38f934c750e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:16 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac Jul 08 19:38:16 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:17 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac" returned: 0 in 0.958s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:17 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:38:17 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:18 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 0.755s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:18 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b Jul 08 19:38:18 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:19 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac.a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" returned: 0 in 0.679s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-a700585a-ae13-4d06-a48d-4c3bb2d9fd4b" released by "_delete_snapshot" :: held 3.635s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" released by "delete_snapshot" :: held 3.665s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Created reservations ['e557385b-b4e3-41f1-ac28-87dbf3fb6ebc', '7ca9a33b-e9ba-49a7-9c88-23698c005e84', '28b56f7f-87fc-4390-832d-9134e7645d79', 'c2f97ea4-a075-41e8-8fd1-5b3652705c3d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:38:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Delete snapshot completed successfully. Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f88d133c-f20c-42cc-bfbb-610dfbe225de tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-a700585a-ae13-4d06-a48d-4c3bb2d9fd4b-delete_snapshot" released by "delete_snapshot" :: held 3.806s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-91d7e56c-27e2-4db4-91d5-721ab3b707ac-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-91d7e56c-27e2-4db4-91d5-721ab3b707ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d135762e-a026-44ce-adb0-489f26961652]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:20 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac Jul 08 19:38:20 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:20 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac" returned: 0 in 0.857s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:20 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac Jul 08 19:38:20 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:21 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-91d7e56c-27e2-4db4-91d5-721ab3b707ac" returned: 0 in 0.703s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-quobyte-91d7e56c-27e2-4db4-91d5-721ab3b707ac" released by "delete_volume" :: held 1.641s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Created reservations ['d03616e4-5744-4ceb-b59d-553b08e267a9', 'e067feb2-88e9-4b49-8daa-cfb661468d33', 'd56f576c-a8da-4993-8889-3896533269e2', 'e1b373a7-2f40-42fe-89a1-2eb373bb6395'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:21 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:38:21 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:22 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.868s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:22 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:38:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Deleted volume successfully. Jul 08 19:38:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98ae1213-0587-45d6-ab30-2557236b0162 tempest-VolumesSnapshotListTestJSON-1152037582 None] Lock "cinder-91d7e56c-27e2-4db4-91d5-721ab3b707ac-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=88,cinder:SELECT=81,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Flow 'volume_create_manager' (cad2b92a-ee8b-44f0-b5fb-090be231d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2594b87c-9f43-474e-82bf-e2e38d81f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2594b87c-9f43-474e-82bf-e2e38d81f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1656848842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10f8bdb-11a0-4f05-99d0-a977fcb3d9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957addf5687f4194a8f14d436fa95ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:38:28Z,use_quota=True,user_id='f0e2ee46787a4de4a76c50d2c5a8591c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ce4bda-d318-48c1-aeab-4d0014675f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ce4bda-d318-48c1-aeab-4d0014675f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b51b4a6-08f0-4bc8-b5c0-8177dde8161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b51b4a6-08f0-4bc8-b5c0-8177dde8161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10f8bdb-11a0-4f05-99d0-a977fcb3d9da', 'volume_name': 'volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1c63fa-d165-4615-990c-8517e24cc183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1c63fa-d165-4615-990c-8517e24cc183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993f17c-6674-4320-8225-15c799707f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:28 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Volume d10f8bdb-11a0-4f05-99d0-a977fcb3d9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da', 'volume_size': 1} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1656848842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10f8bdb-11a0-4f05-99d0-a977fcb3d9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957addf5687f4194a8f14d436fa95ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:38:28Z,use_quota=True,user_id='f0e2ee46787a4de4a76c50d2c5a8591c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Creating volume d10f8bdb-11a0-4f05-99d0-a977fcb3d9da {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:38:28 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:38:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:28 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da 1073741824 Jul 08 19:38:28 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:29 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da 1073741824" returned: 0 in 1.153s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:29 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da Jul 08 19:38:29 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:30 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993f17c-6674-4320-8225-15c799707f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2535bccb-f362-42d3-aae4-758c9cc0ac2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:38:30 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Volume volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da (d10f8bdb-11a0-4f05-99d0-a977fcb3d9da): created successfully Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2535bccb-f362-42d3-aae4-758c9cc0ac2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:38:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Flow 'volume_create_manager' (cad2b92a-ee8b-44f0-b5fb-090be231d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:38:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0f36e8c7-608d-4809-a2c6-f326e7d45ec7 tempest-AttachVolumeNegativeTest-2102385684 None] Created volume successfully. Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:34 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:38:34 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:35 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a18b62-ed7e-450e-85c6-a6ddb9960373]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:35 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da Jul 08 19:38:35 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:35 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.308s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:38:36 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:38:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:38:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:38:36 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" returned: 0 in 1.132s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.178s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90f6c9fa-0a2e-4608-aa1c-03e44acbdb53', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:38:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-2368a506-894c-4e03-ac99-4f5adeea0f48 req-56798462-b8db-4a2c-ac4a-8ac84a951e70 tempest-AttachVolumeNegativeTest-2102385684 None] attachment_update completed successfully. Jul 08 19:38:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-9736f036-0c5a-4683-86b7-3b64ee56745e req-0680d637-4741-4120-a40d-e6016ab0377d tempest-AttachVolumeNegativeTest-2102385684 None] Terminate volume connection completed successfully. Jul 08 19:38:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9736f036-0c5a-4683-86b7-3b64ee56745e req-0680d637-4741-4120-a40d-e6016ab0377d tempest-AttachVolumeNegativeTest-2102385684 None] Deleting attachment 90f6c9fa-0a2e-4608-aa1c-03e44acbdb53. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:38:53 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=42,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:38:53 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:38:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "cinder-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "cinder-quobyte-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-quobyte-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:57 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4f03b-9a16-4e03-ac24-dd0b733f442f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:38:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:57 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da Jul 08 19:38:57 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:58 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" returned: 0 in 1.107s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:58 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da Jul 08 19:38:58 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:59 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" returned: 0 in 0.810s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-quobyte-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da" released by "delete_volume" :: held 1.983s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Created reservations ['c688bb61-da35-41ff-9e7d-edbd2ab5e28f', 'afdfac6b-4e82-4ebd-813b-9a61654d7489', '31a785a6-bcb4-4385-9500-30070405329f', '9e1b227e-fc70-4a38-a863-43bcf75676c8'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:38:59 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:38:59 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:38:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-c3d2499e-09c6-4018-9bb2-bf3b6184ac83 req-61470805-7e1b-4dac-92ef-3cd7b07b3e63 tempest-AttachVolumeTestJSON-688216625 None] Terminate volume connection completed successfully. Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-c3d2499e-09c6-4018-9bb2-bf3b6184ac83 req-61470805-7e1b-4dac-92ef-3cd7b07b3e63 tempest-AttachVolumeTestJSON-688216625 None] Deleting attachment b4ca14ed-1b2e-4d6a-bb13-294445c987d4. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "cinder-3bfb9976-ab06-4d67-88b6-1a52719e5dfc-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-3bfb9976-ab06-4d67-88b6-1a52719e5dfc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:38:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "cinder-quobyte-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-quobyte-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2287f9-5468-4b52-89be-c2e2dcca0776]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:00 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc Jul 08 19:39:00 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:00 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.869s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:00 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Deleted volume successfully. Jul 08 19:39:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-98aca1b3-5c2e-40a4-bc9f-b3a94ad0bf11 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-d10f8bdb-11a0-4f05-99d0-a977fcb3d9da-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:01 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" returned: 0 in 1.113s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:01 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc Jul 08 19:39:01 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:01 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" returned: 0 in 0.782s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-quobyte-3bfb9976-ab06-4d67-88b6-1a52719e5dfc" released by "delete_volume" :: held 1.953s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Created reservations ['ce6b6917-69b0-46b8-8c2e-9d90641e7e1c', '4a28fd00-f696-4a54-9d3b-591970edf315', '2c3d8e4a-97d4-48ce-9de8-f04a23762ff5', 'dbef21d4-240e-42e1-8e9c-1b58083c19e1'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:02 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:02 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "cinder-3a9b74df-4783-402a-ab8f-c2c163bc1921-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-3a9b74df-4783-402a-ab8f-c2c163bc1921-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "cinder-quobyte-3a9b74df-4783-402a-ab8f-c2c163bc1921" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-quobyte-3a9b74df-4783-402a-ab8f-c2c163bc1921" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:03 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7509831-fd25-44af-83b4-05de28214dad]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:03 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 Jul 08 19:39:03 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:03 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.971s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:03 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Deleted volume successfully. Jul 08 19:39:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f6ca0111-9725-4fd9-bceb-fd75c99a5c65 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-3bfb9976-ab06-4d67-88b6-1a52719e5dfc-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:04 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921" returned: 0 in 1.069s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:04 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921 Jul 08 19:39:04 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:04 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3a9b74df-4783-402a-ab8f-c2c163bc1921" returned: 0 in 0.712s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-quobyte-3a9b74df-4783-402a-ab8f-c2c163bc1921" released by "delete_volume" :: held 1.835s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Created reservations ['251166e0-1e39-4ab4-9fb5-4b96e1ca9380', 'aec6289a-bd70-4415-bf16-c6b5d809ba22', 'db731c6b-8242-4f57-a759-52a20f07df1b', '6b0477ec-afaa-44d9-994d-5632c0fceb61'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:04 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:04 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:05 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.720s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:05 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Deleted volume successfully. Jul 08 19:39:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a0529e3-6fdc-46ce-8a41-7ab8cce34f06 tempest-AttachVolumeNegativeTest-2102385684 None] Lock "cinder-3a9b74df-4783-402a-ab8f-c2c163bc1921-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:14 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:39:15 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Flow 'volume_create_manager' (b35c7c91-72b6-468d-91ce-6ee5ccd2c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece3e0cf-3395-42b6-b7f9-7b8c82033da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece3e0cf-3395-42b6-b7f9-7b8c82033da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1795263593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f925f524-f454-4fc5-814b-b00c97a01b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf99570556de477cbd2ed6885826f7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:16Z,use_quota=True,user_id='358bb3e50a1d4e5eb3fb60318106e4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b68747-1a3f-42ea-8143-71f3b71ec00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b68747-1a3f-42ea-8143-71f3b71ec00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e3385b-d6cb-4298-9802-8773eb1cc567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e3385b-d6cb-4298-9802-8773eb1cc567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f925f524-f454-4fc5-814b-b00c97a01b02', 'volume_name': 'volume-f925f524-f454-4fc5-814b-b00c97a01b02', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ff4bcd-f63c-42fd-8b95-05f946f4c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ff4bcd-f63c-42fd-8b95-05f946f4c35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c26eac-7d7c-42a6-bbd5-a6c7f322c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:16 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Volume f925f524-f454-4fc5-814b-b00c97a01b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f925f524-f454-4fc5-814b-b00c97a01b02', 'volume_size': 1} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1795263593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f925f524-f454-4fc5-814b-b00c97a01b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf99570556de477cbd2ed6885826f7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:16Z,use_quota=True,user_id='358bb3e50a1d4e5eb3fb60318106e4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Creating volume f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:16 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:39:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:16 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 1073741824 Jul 08 19:39:16 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:18 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 1073741824" returned: 0 in 1.535s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:18 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 Jul 08 19:39:18 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:19 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02" returned: 0 in 1.071s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] <== create_volume: return (2675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.679s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c26eac-7d7c-42a6-bbd5-a6c7f322c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f925f524-f454-4fc5-814b-b00c97a01b02', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3621f3e-669d-477b-bd6c-e34654307fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Volume volume-f925f524-f454-4fc5-814b-b00c97a01b02 (f925f524-f454-4fc5-814b-b00c97a01b02): created successfully Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3621f3e-669d-477b-bd6c-e34654307fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Flow 'volume_create_manager' (b35c7c91-72b6-468d-91ce-6ee5ccd2c16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-2376df5a-1370-4011-8688-a8f1a5b41f07 req-5b8d13da-d565-4caf-b4de-437c2b33c0df tempest-VolumesSnapshotsTestJSON-1687455398 None] Created volume successfully. Jul 08 19:39:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Creating offline snapshot 413c97d4-97d0-4a98-a29f-ef821781fdc7 of volume f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:39:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4053d111-102c-47d3-a385-dd9fb38c34c9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:21 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 Jul 08 19:39:21 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:21 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (07a03c2d-b1dd-447d-a837-90e85c94df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50281dd0-f201-45f7-8b24-0e0c37ac2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50281dd0-f201-45f7-8b24-0e0c37ac2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1707304689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98c682a-561f-4984-bdba-7f874462a4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:22Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36301739-1e7f-43f1-bbaf-315a55b7aa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36301739-1e7f-43f1-bbaf-315a55b7aa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846dd9a5-bdb3-470f-8327-ab008deb1cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846dd9a5-bdb3-470f-8327-ab008deb1cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98c682a-561f-4984-bdba-7f874462a4e3', 'volume_name': 'volume-f98c682a-561f-4984-bdba-7f874462a4e3', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd351dbe-334b-4045-9bc9-c77d4a2a9e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd351dbe-334b-4045-9bc9-c77d4a2a9e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9b69ff-6bee-4d24-bffc-966b6cf7cf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Volume f98c682a-561f-4984-bdba-7f874462a4e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98c682a-561f-4984-bdba-7f874462a4e3', 'volume_size': 1} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:22 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02" returned: 0 in 1.636s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:22 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 1G Jul 08 19:39:22 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:24 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 1G" returned: 0 in 1.227s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f925f524-f454-4fc5-814b-b00c97a01b02 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:24 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f925f524-f454-4fc5-814b-b00c97a01b02 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 Jul 08 19:39:24 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:25 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f925f524-f454-4fc5-814b-b00c97a01b02 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7" returned: 0 in 1.014s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:25 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 is being set with open permissions: ugo+rw Jul 08 19:39:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:25 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 Jul 08 19:39:25 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:25 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:26 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info Jul 08 19:39:26 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:26 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info" returned: 0 in 0.709s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:26 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info is being set with open permissions: ugo+rw Jul 08 19:39:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:26 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info Jul 08 19:39:26 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:27 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.info" returned: 0 in 0.671s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.231s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.278s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1707304689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98c682a-561f-4984-bdba-7f874462a4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:22Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Creating volume f98c682a-561f-4984-bdba-7f874462a4e3 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:27 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:39:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:27 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 1073741824 Jul 08 19:39:27 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-5803cdd4-2a37-4ba7-a6ca-98d60e31c4e7 req-e40157ac-8fd8-4f1c-a7f3-74fee2631d3b tempest-VolumesSnapshotsTestJSON-1687455398 None] Create snapshot completed successfully Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "cinder-413c97d4-97d0-4a98-a29f-ef821781fdc7-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-413c97d4-97d0-4a98-a29f-ef821781fdc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "cinder-quobyte-f925f524-f454-4fc5-814b-b00c97a01b02" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-quobyte-f925f524-f454-4fc5-814b-b00c97a01b02" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "cinder-quobyte-413c97d4-97d0-4a98-a29f-ef821781fdc7" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-quobyte-413c97d4-97d0-4a98-a29f-ef821781fdc7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Deleting offline snapshot 413c97d4-97d0-4a98-a29f-ef821781fdc7 of volume f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] snapshot_file for this snap is: volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a8d2d4-4ddd-49d6-83d4-c67e6671a985]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:28 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 1073741824" returned: 0 in 1.436s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:28 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 Jul 08 19:39:28 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:29 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 Jul 08 19:39:29 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:29 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3" returned: 0 in 1.033s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] <== create_volume: return (2548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:39:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9b69ff-6bee-4d24-bffc-966b6cf7cf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98c682a-561f-4984-bdba-7f874462a4e3', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347b0410-f535-4404-abf4-75641262fd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:30 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Volume volume-f98c682a-561f-4984-bdba-7f874462a4e3 (f98c682a-561f-4984-bdba-7f874462a4e3): created successfully Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347b0410-f535-4404-abf4-75641262fd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (07a03c2d-b1dd-447d-a837-90e85c94df64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fffe6388-3398-416b-9cd5-3d48a33a44a7 tempest-VolumesActionsTest-1010600651 None] Created volume successfully. Jul 08 19:39:30 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7" returned: 0 in 1.284s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f925f524-f454-4fc5-814b-b00c97a01b02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[107bf53d-3be7-4977-a597-1d722170f5aa]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:30 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 Jul 08 19:39:30 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a28080fa-4d83-44ac-ad50-b72f940f6a79 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3" by "attach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a28080fa-4d83-44ac-ad50-b72f940f6a79 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3" acquired by "attach_volume" :: waited 0.035s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a28080fa-4d83-44ac-ad50-b72f940f6a79 tempest-VolumesActionsTest-1010600651 None] Attaching volume f98c682a-561f-4984-bdba-7f874462a4e3 to instance 6af1cf64-b266-41ad-bf48-30f9a4b59d6d at mountpoint /dev/vdb on host None. Jul 08 19:39:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a28080fa-4d83-44ac-ad50-b72f940f6a79 tempest-VolumesActionsTest-1010600651 None] Attach volume completed successfully. Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a28080fa-4d83-44ac-ad50-b72f940f6a79 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3" released by "attach_volume" :: held 0.195s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:30 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02" returned: 0 in 0.878s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:31 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 Jul 08 19:39:31 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:31 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:31 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7 Jul 08 19:39:31 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bf4cd153-471e-4e44-b032-74d0d3982195 tempest-VolumesActionsTest-1981361108 None] Terminate volume connection completed successfully. Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bf4cd153-471e-4e44-b032-74d0d3982195 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-detach_volume" by "detach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bf4cd153-471e-4e44-b032-74d0d3982195 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:32 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02.413c97d4-97d0-4a98-a29f-ef821781fdc7" returned: 0 in 0.777s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bf4cd153-471e-4e44-b032-74d0d3982195 tempest-VolumesActionsTest-1981361108 None] Detaching volume f98c682a-561f-4984-bdba-7f874462a4e3 from instance 6af1cf64-b266-41ad-bf48-30f9a4b59d6d. Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-quobyte-413c97d4-97d0-4a98-a29f-ef821781fdc7" released by "_delete_snapshot" :: held 3.920s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-quobyte-f925f524-f454-4fc5-814b-b00c97a01b02" released by "delete_snapshot" :: held 3.971s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bf4cd153-471e-4e44-b032-74d0d3982195 tempest-VolumesActionsTest-1981361108 None] Detach volume completed successfully. Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bf4cd153-471e-4e44-b032-74d0d3982195 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.quota [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Created reservations ['271af76e-e314-4289-abe8-59bc4d29f688', '8bc6963d-f54d-4294-ac63-64eb937c4a50', '85a0410d-5426-4a60-b154-ba4febe081d4', 'a88ca8c5-6e4a-4948-867a-f96a7cbebd43'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Delete snapshot completed successfully. Jul 08 19:39:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-459c3cb4-78bd-4a10-8b14-d270b30791dc req-4b0f2394-818e-4539-a82a-a4ed4f8661b3 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-413c97d4-97d0-4a98-a29f-ef821781fdc7-delete_snapshot" released by "delete_snapshot" :: held 4.181s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f121354c-fd61-416b-b15e-361511967b08 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-detach_volume" by "detach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "cinder-f925f524-f454-4fc5-814b-b00c97a01b02-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f121354c-fd61-416b-b15e-361511967b08 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:33 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f121354c-fd61-416b-b15e-361511967b08 tempest-VolumesActionsTest-1010600651 None] Volume detach called, but volume not attached. Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-f925f524-f454-4fc5-814b-b00c97a01b02-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f121354c-fd61-416b-b15e-361511967b08 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "cinder-quobyte-f925f524-f454-4fc5-814b-b00c97a01b02" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-quobyte-f925f524-f454-4fc5-814b-b00c97a01b02" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee509c6c-2d9d-4d99-848a-47ecfc0b780b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:33 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 Jul 08 19:39:33 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Acquiring lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Acquiring lock "cinder-quobyte-f98c682a-561f-4984-bdba-7f874462a4e3" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Lock "cinder-quobyte-f98c682a-561f-4984-bdba-7f874462a4e3" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f63da8-0e4e-4983-bd1f-f1f4f60af1ef]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:34 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 Jul 08 19:39:34 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:34 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02" returned: 0 in 0.917s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:34 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02 Jul 08 19:39:34 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:34 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:34 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:35 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f925f524-f454-4fc5-814b-b00c97a01b02" returned: 0 in 0.780s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:35 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3" returned: 0 in 0.954s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-quobyte-f925f524-f454-4fc5-814b-b00c97a01b02" released by "delete_volume" :: held 1.780s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:35 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3 Jul 08 19:39:35 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.quota [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Created reservations ['58604915-a8f2-4c76-ba8b-86257821a0a1', '35d7bb24-905a-47de-b804-71e4efd903c8', '77f55d97-78fd-4da8-90e2-b6e89caf1457', '0c213d19-4777-451d-89cc-d7ab0536936b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:35 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:35 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:35 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.780s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:39:35 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f98c682a-561f-4984-bdba-7f874462a4e3" returned: 0 in 0.773s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Lock "cinder-quobyte-f98c682a-561f-4984-bdba-7f874462a4e3" released by "delete_volume" :: held 1.790s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Created reservations ['916c69b5-9ff1-426c-aa2f-1663bffa9112', 'ba4f5a2c-f15b-40a5-9a5a-9fe44441387c', '00b3a1e0-d3cf-4619-8e22-51fb4af1d13d', '671d9196-805e-4365-b5f5-0c6a30ebd0c6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:36 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.774s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.manager [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Deleted volume successfully. Jul 08 19:39:36 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:36 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-495f9567-44a5-43f3-b3a0-87b50fc2594c req-12b7fefd-3751-4931-95d0-911c4bc98919 tempest-VolumesSnapshotsTestJSON-1687455398 None] Lock "cinder-f925f524-f454-4fc5-814b-b00c97a01b02-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:36 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.824s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Deleted volume successfully. Jul 08 19:39:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c9c8bbaf-b5e8-449c-abbd-b223a1bb171a tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f98c682a-561f-4984-bdba-7f874462a4e3-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e089ba85-982d-4c42-8176-3698ea5e8d8d tempest-GroupSnapshotsTest-357969510 None] Group tempest-GroupSnapshotsTest-Group-365361135: creating Jul 08 19:39:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e089ba85-982d-4c42-8176-3698ea5e8d8d tempest-GroupSnapshotsTest-357969510 None] Group tempest-GroupSnapshotsTest-Group-365361135: created successfully Jul 08 19:39:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e089ba85-982d-4c42-8176-3698ea5e8d8d tempest-GroupSnapshotsTest-357969510 None] Create group completed successfully. Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (a2fc7399-3b49-41ea-bf96-6def69e751fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f7a08b-8ced-4ff5-9f70-0d5a92d96636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f7a08b-8ced-4ff5-9f70-0d5a92d96636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056318371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd39622d-f6f4-4e47-ab35-3f0b921d0fce,host='devstack@QuobyteHD#QuobyteHD',id=84d986a5-9454-44cf-b0bb-dec5f331fabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:42Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a00f99-2f8b-4d4c-9ff7-cca21413b153),volume_type_id=f3a00f99-2f8b-4d4c-9ff7-cca21413b153)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7784930-f75c-45b4-81ab-2b6699ef8dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7784930-f75c-45b4-81ab-2b6699ef8dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2600fe-3a82-49a2-9d1d-97d2717045d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2600fe-3a82-49a2-9d1d-97d2717045d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d986a5-9454-44cf-b0bb-dec5f331fabe', 'volume_name': 'volume-84d986a5-9454-44cf-b0bb-dec5f331fabe', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9704957-5728-450f-9e52-f7a359482e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9704957-5728-450f-9e52-f7a359482e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37901204-28d2-4dae-a6cd-3da63cf35523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:42 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Volume 84d986a5-9454-44cf-b0bb-dec5f331fabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d986a5-9454-44cf-b0bb-dec5f331fabe', 'volume_size': 1} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd39622d-f6f4-4e47-ab35-3f0b921d0fce,created_at=2026-07-08T17:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056318371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd39622d-f6f4-4e47-ab35-3f0b921d0fce,host='devstack@QuobyteHD#QuobyteHD',id=84d986a5-9454-44cf-b0bb-dec5f331fabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:42Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3a00f99-2f8b-4d4c-9ff7-cca21413b153),volume_type_id=f3a00f99-2f8b-4d4c-9ff7-cca21413b153)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Creating volume 84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:42 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:42 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe 1073741824 Jul 08 19:39:42 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:42 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe 1073741824" returned: 0 in 0.945s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:43 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:39:43 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (791593a2-1118-4052-b89c-102582871c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7760224f-f03b-45de-bbd8-2d581a04b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7760224f-f03b-45de-bbd8-2d581a04b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472675646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2dfca4-04dc-4586-ac37-182d37a749c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:44Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e57407-a760-4a7f-8909-5a3ec73f3986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e57407-a760-4a7f-8909-5a3ec73f3986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49c7fe8-608f-4157-bded-e642d84c8d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49c7fe8-608f-4157-bded-e642d84c8d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2dfca4-04dc-4586-ac37-182d37a749c2', 'volume_name': 'volume-fe2dfca4-04dc-4586-ac37-182d37a749c2', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653e6e4c-475e-40e4-a942-437de336fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653e6e4c-475e-40e4-a942-437de336fd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a9fa4f-b0a7-4988-9121-9ae2c887da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:43 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Volume fe2dfca4-04dc-4586-ac37-182d37a749c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2dfca4-04dc-4586-ac37-182d37a749c2', 'volume_size': 1} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:43 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 0.748s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-472675646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2dfca4-04dc-4586-ac37-182d37a749c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:44Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Creating volume fe2dfca4-04dc-4586-ac37-182d37a749c2 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:43 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:43 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 1073741824 Jul 08 19:39:43 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37901204-28d2-4dae-a6cd-3da63cf35523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d986a5-9454-44cf-b0bb-dec5f331fabe', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1dee98-3ba8-49fd-9d63-aea9a273efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:43 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Volume volume-84d986a5-9454-44cf-b0bb-dec5f331fabe (84d986a5-9454-44cf-b0bb-dec5f331fabe): created successfully Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1dee98-3ba8-49fd-9d63-aea9a273efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (a2fc7399-3b49-41ea-bf96-6def69e751fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-68f5c3ef-dd24-4781-9e18-19563ee14f66 tempest-GroupSnapshotsTest-357969510 None] Created volume successfully. Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Flow 'volume_create_manager' (b90c6e31-6389-40f3-843d-f12b425529f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71780e4e-d764-4663-b417-a56f4e467a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71780e4e-d764-4663-b417-a56f4e467a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1256962141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee57855f-ee60-44c1-b611-f8a9afd65c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fe66c4c64e43159bb3acccce50bbba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:44Z,use_quota=True,user_id='948f2b01e4ee4917a7a312fcba1c99d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda385e7-2ed3-491b-b872-9735a96181af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda385e7-2ed3-491b-b872-9735a96181af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6993c961-194d-4acf-9abb-cfd4a20672bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6993c961-194d-4acf-9abb-cfd4a20672bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee57855f-ee60-44c1-b611-f8a9afd65c46', 'volume_name': 'volume-ee57855f-ee60-44c1-b611-f8a9afd65c46', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868fecbf-7989-4f5a-94fd-6849aaa6257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868fecbf-7989-4f5a-94fd-6849aaa6257e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b2efd5-d40a-43d1-99f8-d0f9ce141c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Volume ee57855f-ee60-44c1-b611-f8a9afd65c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee57855f-ee60-44c1-b611-f8a9afd65c46', 'volume_size': 1} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] GroupSnapshot 3c26f10d-1dda-49a6-bb7c-047f32dd4d24: creating. Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Group snapshot 3c26f10d-1dda-49a6-bb7c-047f32dd4d24: creating. {{(pid=87172) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:44 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 1073741824" returned: 0 in 0.901s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:44 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 Jul 08 19:39:44 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:45 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2" returned: 0 in 0.621s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1256962141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee57855f-ee60-44c1-b611-f8a9afd65c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fe66c4c64e43159bb3acccce50bbba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:44Z,use_quota=True,user_id='948f2b01e4ee4917a7a312fcba1c99d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Creating volume ee57855f-ee60-44c1-b611-f8a9afd65c46 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:45 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a9fa4f-b0a7-4988-9121-9ae2c887da37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2dfca4-04dc-4586-ac37-182d37a749c2', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:45 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 1073741824 Jul 08 19:39:45 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f284010d-3686-4096-a4be-fd600ca3bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Volume volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 (fe2dfca4-04dc-4586-ac37-182d37a749c2): created successfully Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f284010d-3686-4096-a4be-fd600ca3bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (791593a2-1118-4052-b89c-102582871c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:45 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8c127a51-169f-4e86-9095-3cd32c348bef tempest-VolumesActionsTest-1010600651 None] Created volume successfully. Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-fe2dfca4-04dc-4586-ac37-182d37a749c2-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Lock "cinder-fe2dfca4-04dc-4586-ac37-182d37a749c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-quobyte-fe2dfca4-04dc-4586-ac37-182d37a749c2" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-fe2dfca4-04dc-4586-ac37-182d37a749c2" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[221c464e-4966-486f-82c0-62835e2e96e6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:46 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 Jul 08 19:39:46 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:46 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 1073741824" returned: 0 in 0.933s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:46 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 Jul 08 19:39:46 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:46 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2" returned: 0 in 0.882s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:46 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2 Jul 08 19:39:46 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:47 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46" returned: 0 in 0.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.427s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b2efd5-d40a-43d1-99f8-d0f9ce141c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee57855f-ee60-44c1-b611-f8a9afd65c46', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269d58f8-306d-48a0-abc7-a84890cf7da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Creating offline snapshot 5f0b8bda-f374-4883-85f3-c255bd40b729 of volume 84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:39:47 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Volume volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 (ee57855f-ee60-44c1-b611-f8a9afd65c46): created successfully Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269d58f8-306d-48a0-abc7-a84890cf7da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Flow 'volume_create_manager' (b90c6e31-6389-40f3-843d-f12b425529f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[58646b6a-8ff6-4a0d-88aa-b0ef85e1fc23]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:47 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2d105cac-2e78-44e7-89b2-17c4f57d016c tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Created volume successfully. Jul 08 19:39:47 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:39:47 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:47 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fe2dfca4-04dc-4586-ac37-182d37a749c2" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-fe2dfca4-04dc-4586-ac37-182d37a749c2" released by "delete_volume" :: held 1.657s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Created reservations ['a789deb3-5ea9-40fc-ae6e-9548e2cb06c9', '5f8fb49c-9507-4063-b2a1-9e4fbf6dced5', '780790ec-4df5-4083-b2d6-a913d0e20cb0', 'd24f1f4e-15f5-4531-b594-2409ea623fc8'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:47 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:47 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:48 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 0.949s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:48 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 1G Jul 08 19:39:48 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:48 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.716s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Deleted volume successfully. Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eeda9d83-7f13-4299-9d4e-1d12662a20ea tempest-VolumesActionsTest-1981361108 None] Lock "cinder-fe2dfca4-04dc-4586-ac37-182d37a749c2-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (0f91ee3c-7ec2-4d0b-bff4-350a871ceba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ec4977-2728-4f2f-b362-38baad5f7d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ec4977-2728-4f2f-b362-38baad5f7d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813077780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8baf1da-8cc8-4905-94cb-b229f652bf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:49Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd72f743-ddb7-4a4e-9cdf-de9c4f625975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd72f743-ddb7-4a4e-9cdf-de9c4f625975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac746986-1226-45f0-a4b0-b129f45c5e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac746986-1226-45f0-a4b0-b129f45c5e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8baf1da-8cc8-4905-94cb-b229f652bf8c', 'volume_name': 'volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1224533c-f45c-4d54-a61c-bc28f8b06118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1224533c-f45c-4d54-a61c-bc28f8b06118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4f7dd9-8355-47ea-91f8-e827f460b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Volume c8baf1da-8cc8-4905-94cb-b229f652bf8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c', 'volume_size': 1} Jul 08 19:39:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:49 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 1G" returned: 0 in 1.010s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d986a5-9454-44cf-b0bb-dec5f331fabe -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:49 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d986a5-9454-44cf-b0bb-dec5f331fabe -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 Jul 08 19:39:49 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:49 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d986a5-9454-44cf-b0bb-dec5f331fabe -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729" returned: 0 in 0.755s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:49 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:39:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:49 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 Jul 08 19:39:49 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:50 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729" returned: 0 in 0.659s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:50 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info Jul 08 19:39:50 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:51 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info" returned: 0 in 0.664s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:51 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:51 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info Jul 08 19:39:51 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:51 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.info" returned: 0 in 0.633s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.787s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.947s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813077780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8baf1da-8cc8-4905-94cb-b229f652bf8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:49Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Creating volume c8baf1da-8cc8-4905-94cb-b229f652bf8c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:51 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:39:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:51 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c 1073741824 Jul 08 19:39:51 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-794b3973-583e-4f47-8f87-fde6f407fbe4 tempest-GroupSnapshotsTest-357969510 None] group_snapshot 3c26f10d-1dda-49a6-bb7c-047f32dd4d24: created successfully Jul 08 19:39:52 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c 1073741824" returned: 0 in 0.835s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:52 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c Jul 08 19:39:52 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:53 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c" returned: 0 in 0.665s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.728s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4f7dd9-8355-47ea-91f8-e827f460b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a409d0f-7e36-4c2e-baff-5bc460f1ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f344a7c9-23d9-4325-b3fb-ac78d843108d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Volume volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c (c8baf1da-8cc8-4905-94cb-b229f652bf8c): created successfully Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a409d0f-7e36-4c2e-baff-5bc460f1ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (0f91ee3c-7ec2-4d0b-bff4-350a871ceba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9615271c-227a-46c6-91dc-c30b6ecf861e tempest-VolumesActionsTest-1010600651 None] Created volume successfully. Jul 08 19:39:53 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 Jul 08 19:39:53 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:54 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46" returned: 0 in 0.841s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-5f0b8bda-f374-4883-85f3-c255bd40b729-0df34329-de9c-4847-bdd1-ecfd45e38692" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-5f0b8bda-f374-4883-85f3-c255bd40b729-0df34329-de9c-4847-bdd1-ecfd45e38692" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Creating volume 0df34329-de9c-4847-bdd1-ecfd45e38692 from snapshot 5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-0df34329-de9c-4847-bdd1-ecfd45e38692" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-ee57855f-ee60-44c1-b611-f8a9afd65c46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '673ed9ca-7aef-4b26-b930-573d18bb389a', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-0df34329-de9c-4847-bdd1-ecfd45e38692" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] snapshot: 5f0b8bda-f374-4883-85f3-c255bd40b729, volume: 0df34329-de9c-4847-bdd1-ecfd45e38692, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189ee0c-0387-40a6-a17c-15f6a5cda7c5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-607ca23c-2331-4801-a8e9-dec23ed775c6 req-f63fda4b-60f6-4a98-a3d8-36bd78da6261 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] attachment_update completed successfully. Jul 08 19:39:54 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 Jul 08 19:39:54 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-c8baf1da-8cc8-4905-94cb-b229f652bf8c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-c8baf1da-8cc8-4905-94cb-b229f652bf8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-quobyte-c8baf1da-8cc8-4905-94cb-b229f652bf8c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-c8baf1da-8cc8-4905-94cb-b229f652bf8c" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031865f-ada9-45b1-9466-c9ab1fcabd8c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:55 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c Jul 08 19:39:55 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:55 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729" returned: 0 in 1.182s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d986a5-9454-44cf-b0bb-dec5f331fabe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d107dee-9b35-447e-b916-e39532b4f077]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:39:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:55 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:39:55 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:56 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c" returned: 0 in 1.068s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:56 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c Jul 08 19:39:56 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:56 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 1.057s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:56 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:39:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:56 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 Jul 08 19:39:56 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:57 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c8baf1da-8cc8-4905-94cb-b229f652bf8c" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-c8baf1da-8cc8-4905-94cb-b229f652bf8c" released by "delete_volume" :: held 2.007s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Created reservations ['b30f812e-5bc8-4f03-9fba-695870f1db54', 'a4d6fbf9-d8b7-4dc5-b6f5-c20f766c59b7', '61a03e58-a87d-4f5f-bc3c-67a9d9063880', '035dd054-0f45-4b76-b620-e9a0402129e1'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:39:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:39:57 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:39:57 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (1a8668d2-173d-4724-aaf5-b375259b5a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:39:58 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c9492b-9fa8-4a31-a350-ad7134700469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.303s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:39:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Deleted volume successfully. Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c9492b-9fa8-4a31-a350-ad7134700469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-28030161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a37d72-7452-4881-a98c-c6464fec990c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:58Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1edbb4-5fe0-4f0c-965a-19df6e0a4656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1edbb4-5fe0-4f0c-965a-19df6e0a4656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015267c0-5935-4de8-ab5b-bf04014fccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015267c0-5935-4de8-ab5b-bf04014fccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59a37d72-7452-4881-a98c-c6464fec990c', 'volume_name': 'volume-59a37d72-7452-4881-a98c-c6464fec990c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538474c6-6806-4b1d-adf9-5653212d5f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538474c6-6806-4b1d-adf9-5653212d5f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31fdbbc-bb8a-4d41-af64-9af72f778209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:39:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Volume 59a37d72-7452-4881-a98c-c6464fec990c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59a37d72-7452-4881-a98c-c6464fec990c', 'volume_size': 1} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:39:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cb437778-b5e1-4800-a0e0-c3068f071421 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-c8baf1da-8cc8-4905-94cb-b229f652bf8c-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:03 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692" returned: 0 in 6.831s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:03 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1a5fc4-f676-4443-8573-e64e15f2f983]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:03 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:40:03 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:04 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 0.996s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:04 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:40:04 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Converted 1024.00 MB image at 149.89 MB/s Jul 08 19:40:04 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:40:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:04 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 Jul 08 19:40:04 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:05 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-0df34329-de9c-4847-bdd1-ecfd45e38692" released by "_copy_volume_from_snapshot" :: held 10.981s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-5f0b8bda-f374-4883-85f3-c255bd40b729-0df34329-de9c-4847-bdd1-ecfd45e38692" released by "_create_volume_from_snapshot" :: held 11.063s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.096s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.593s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-28030161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a37d72-7452-4881-a98c-c6464fec990c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:39:58Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Creating volume 59a37d72-7452-4881-a98c-c6464fec990c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:05 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:05 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c 1073741824 Jul 08 19:40:05 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f046eb14-812a-4cb0-b934-d3beb9ea3bb8 tempest-GroupSnapshotsTest-357969510 None] Create group from source-snapshot-3c26f10d-1dda-49a6-bb7c-047f32dd4d24 completed successfully. Jul 08 19:40:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-0df34329-de9c-4847-bdd1-ecfd45e38692" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-0df34329-de9c-4847-bdd1-ecfd45e38692" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf7f390-7bcc-49bd-aa9e-4a50f337e5a2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:06 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 Jul 08 19:40:06 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:06 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c 1073741824" returned: 0 in 1.091s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:06 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c Jul 08 19:40:06 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-4f52b4fa-255f-4726-8fa1-0adf660654d6 req-31468a03-aec0-4cb2-a4b8-7dacc4a465d1 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Terminate volume connection completed successfully. Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-4f52b4fa-255f-4726-8fa1-0adf660654d6 req-31468a03-aec0-4cb2-a4b8-7dacc4a465d1 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Deleting attachment 673ed9ca-7aef-4b26-b930-573d18bb389a. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:40:07 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692" returned: 0 in 1.025s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:07 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692 Jul 08 19:40:07 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:07 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c" returned: 0 in 0.982s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31fdbbc-bb8a-4d41-af64-9af72f778209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59a37d72-7452-4881-a98c-c6464fec990c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50165f8f-91d7-4c88-b77a-e02b34b5d289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:07 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Volume volume-59a37d72-7452-4881-a98c-c6464fec990c (59a37d72-7452-4881-a98c-c6464fec990c): created successfully Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50165f8f-91d7-4c88-b77a-e02b34b5d289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (1a8668d2-173d-4724-aaf5-b375259b5a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-08a629f1-369b-412a-871e-cec4e694d48a tempest-VolumesActionsTest-1010600651 None] Created volume successfully. Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-59a37d72-7452-4881-a98c-c6464fec990c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-59a37d72-7452-4881-a98c-c6464fec990c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:08 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df34329-de9c-4847-bdd1-ecfd45e38692" returned: 0 in 0.832s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-0df34329-de9c-4847-bdd1-ecfd45e38692" released by "delete_volume" :: held 1.924s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-quobyte-59a37d72-7452-4881-a98c-c6464fec990c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-59a37d72-7452-4881-a98c-c6464fec990c" acquired by "delete_volume" :: waited 0.055s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[164d43cd-1ba7-4e75-b469-4cc3012821d1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['88d8860b-7605-4579-988a-7ea32cb343a5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:08 devstack cinder-volume[87172]: WARNING cinder.quota [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1225705273 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1225705273, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:40:08 devstack cinder-volume[87172]: WARNING cinder.quota [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1225705273 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1225705273, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['78b608ff-7a0b-42ab-98f2-dae474c55dd2', 'e1b5ad9e-6ee3-4470-8661-7ba6e5b55f8e', '4dba7e9f-4d13-4870-bee6-0062a1d459bc', '930c1ac4-3f1b-49eb-8869-1eaf7e205add'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:08 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c Jul 08 19:40:08 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:08 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:08 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Acquiring lock "cinder-ee57855f-ee60-44c1-b611-f8a9afd65c46-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "cinder-ee57855f-ee60-44c1-b611-f8a9afd65c46-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Acquiring lock "cinder-quobyte-ee57855f-ee60-44c1-b611-f8a9afd65c46" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "cinder-quobyte-ee57855f-ee60-44c1-b611-f8a9afd65c46" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ec77d-9cba-45a9-9d9d-52fd4ec263fd]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] group_snapshot 3c26f10d-1dda-49a6-bb7c-047f32dd4d24: deleting Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] group_snapshot 3c26f10d-1dda-49a6-bb7c-047f32dd4d24: deleting {{(pid=87172) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-84d986a5-9454-44cf-b0bb-dec5f331fabe" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-84d986a5-9454-44cf-b0bb-dec5f331fabe" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-5f0b8bda-f374-4883-85f3-c255bd40b729" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-5f0b8bda-f374-4883-85f3-c255bd40b729" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Deleting offline snapshot 5f0b8bda-f374-4883-85f3-c255bd40b729 of volume 84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] snapshot_file for this snap is: volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad9596-90ef-4e76-a2d4-2d4f5304055d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:09 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 Jul 08 19:40:09 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:09 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 Jul 08 19:40:09 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:09 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.341s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:09 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:09 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f08dd9a4-d8b7-4e7c-a4ac-113e3a10d943 tempest-GroupSnapshotsTest-357969510 None] Delete group completed successfully. Jul 08 19:40:09 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c" returned: 0 in 1.690s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:10 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c Jul 08 19:40:10 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:10 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46" returned: 0 in 1.456s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:10 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46 Jul 08 19:40:10 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:10 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729" returned: 0 in 1.513s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d986a5-9454-44cf-b0bb-dec5f331fabe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e5e9e-65a3-491a-bd46-f1fac09e423b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:10 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:40:10 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:10 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-59a37d72-7452-4881-a98c-c6464fec990c" returned: 0 in 0.888s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-59a37d72-7452-4881-a98c-c6464fec990c" released by "delete_volume" :: held 2.639s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:10 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Created reservations ['52cef7ab-39eb-4900-9ff0-a9c5bb6c109e', 'fbe13f75-8033-4556-9b63-ec2722d435e4', '5206f7e0-bbb2-45a4-ae71-374c44c86a7e', '9c3d1d89-b4a5-4f5b-954c-8ab0096b8df4'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:11 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:11 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:11 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ee57855f-ee60-44c1-b611-f8a9afd65c46" returned: 0 in 0.963s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "cinder-quobyte-ee57855f-ee60-44c1-b611-f8a9afd65c46" released by "delete_volume" :: held 2.487s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Created reservations ['95e8a975-1715-4dfa-a31b-f281ecccc781', '308aa016-fb04-460f-92c9-aea0b89e8e8e', 'a08fd404-a0fe-4753-9055-0648271157cd', '1d3f9fbe-98dc-4ede-b0c8-fba7c3a1cc9e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:11 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:11 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:11 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 1.164s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:11 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 Jul 08 19:40:11 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:11 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.729s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Deleted volume successfully. Jul 08 19:40:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-71f85031-6b9b-4832-9487-7dc103fb76f2 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-59a37d72-7452-4881-a98c-c6464fec990c-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:12 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.855s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Deleted volume successfully. Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-56aa9a20-dfc6-4e1a-88e6-7f5972e86394 tempest-TestServerVolumeAttachScenarioOldVersion-1320624426 None] Lock "cinder-ee57855f-ee60-44c1-b611-f8a9afd65c46-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (6652c2b9-b3df-4930-a908-c39b2603fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caeb3b5c-dba2-4023-84c2-0997dbc693fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caeb3b5c-dba2-4023-84c2-0997dbc693fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1657572968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f183fe-e2a8-4c01-a112-2118922c97f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:12Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74494d2e-217f-4f9a-b0d8-1d5009e14c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74494d2e-217f-4f9a-b0d8-1d5009e14c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada3a9ad-68da-4835-8863-953c599bea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada3a9ad-68da-4835-8863-953c599bea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f183fe-e2a8-4c01-a112-2118922c97f5', 'volume_name': 'volume-d7f183fe-e2a8-4c01-a112-2118922c97f5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75b14d8-6c5e-49c1-ad89-92b24b69d58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75b14d8-6c5e-49c1-ad89-92b24b69d58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312ae144-83c3-41df-b0ab-b7eb83510cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:12 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Volume d7f183fe-e2a8-4c01-a112-2118922c97f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f183fe-e2a8-4c01-a112-2118922c97f5', 'volume_size': 1} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1657572968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f183fe-e2a8-4c01-a112-2118922c97f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:12Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Creating volume d7f183fe-e2a8-4c01-a112-2118922c97f5 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:12 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:12 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 1073741824 Jul 08 19:40:12 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:12 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729" returned: 0 in 1.139s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:12 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729 Jul 08 19:40:12 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:13 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe.5f0b8bda-f374-4883-85f3-c255bd40b729" returned: 0 in 0.722s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-5f0b8bda-f374-4883-85f3-c255bd40b729" released by "_delete_snapshot" :: held 4.654s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-84d986a5-9454-44cf-b0bb-dec5f331fabe" released by "delete_snapshot" :: held 4.691s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:13 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 1073741824" returned: 0 in 0.983s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:13 devstack cinder-volume[87172]: WARNING cinder.quota [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1225705273 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1225705273, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:40:13 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 Jul 08 19:40:13 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:13 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] Created reservations ['95b12dba-a7a1-477b-acfa-e434371af00c', 'e88e7e69-2f9b-4ced-a87e-9b623615fadd', 'f51d383a-0805-4b55-8bfc-c4d12257ede3', '99fcea81-dbc3-4c5f-ab24-f27b893bd7b9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5278629d-b892-4039-b6ad-aa8d5291dc8c tempest-GroupSnapshotsTest-357969510 None] group_snapshot 3c26f10d-1dda-49a6-bb7c-047f32dd4d24: deleted successfully Jul 08 19:40:14 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5" returned: 0 in 0.825s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312ae144-83c3-41df-b0ab-b7eb83510cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f183fe-e2a8-4c01-a112-2118922c97f5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40938d5d-d6e4-44b7-8524-d6b4b265bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:14 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Volume volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 (d7f183fe-e2a8-4c01-a112-2118922c97f5): created successfully Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40938d5d-d6e4-44b7-8524-d6b4b265bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (6652c2b9-b3df-4930-a908-c39b2603fb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:14 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-384ec0e1-4652-4ee1-a7d6-f607ad9d2e63 tempest-VolumesActionsTest-1010600651 None] Created volume successfully. Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-84d986a5-9454-44cf-b0bb-dec5f331fabe" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-84d986a5-9454-44cf-b0bb-dec5f331fabe" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68875f-7f27-44f8-8695-2519198061a9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:15 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:40:15 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:15 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 0.881s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:15 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe Jul 08 19:40:15 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-d7f183fe-e2a8-4c01-a112-2118922c97f5-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-d7f183fe-e2a8-4c01-a112-2118922c97f5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=100,cinder:UPDATE=115,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=98,cinder:UPDATE=98,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "cinder-quobyte-d7f183fe-e2a8-4c01-a112-2118922c97f5" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-d7f183fe-e2a8-4c01-a112-2118922c97f5" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda79f1a-0f9a-487f-b7c9-603fd471cef3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:16 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 Jul 08 19:40:16 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:16 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-84d986a5-9454-44cf-b0bb-dec5f331fabe" returned: 0 in 1.050s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-84d986a5-9454-44cf-b0bb-dec5f331fabe" released by "delete_volume" :: held 2.021s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:16 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['38cb5294-3a16-497c-9e17-926c9c9834ef'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:17 devstack cinder-volume[87172]: WARNING cinder.db.sqlalchemy.api [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1225705273'] Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['b23391a8-9195-409b-bb44-a4a32ec3fb8a', '63b3a05c-7ff4-430f-9f92-e98f2ef7aecc', '4d7c81a9-734a-4fc6-b044-870bee73dca8', 'eb9ddd70-9bf9-4b27-84ed-3c1e7a7e32f8'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:17 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:17 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:17 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5" returned: 0 in 1.147s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:17 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5 Jul 08 19:40:17 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:17 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.721s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:17 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef53d598-8c92-41b0-ba8a-7c914289d5e0 tempest-GroupSnapshotsTest-357969510 None] Delete group completed successfully. Jul 08 19:40:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-11f59ac2-78b8-4f52-a9e9-34e032e9f33e tempest-GroupSnapshotsTest-357969510 None] Group tempest-GroupSnapshotsTest-Group-1730318242: creating Jul 08 19:40:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-11f59ac2-78b8-4f52-a9e9-34e032e9f33e tempest-GroupSnapshotsTest-357969510 None] Group tempest-GroupSnapshotsTest-Group-1730318242: created successfully Jul 08 19:40:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-11f59ac2-78b8-4f52-a9e9-34e032e9f33e tempest-GroupSnapshotsTest-357969510 None] Create group completed successfully. Jul 08 19:40:18 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d7f183fe-e2a8-4c01-a112-2118922c97f5" returned: 0 in 0.752s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-quobyte-d7f183fe-e2a8-4c01-a112-2118922c97f5" released by "delete_volume" :: held 1.973s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Created reservations ['f0e68abb-076e-4d85-a1c6-9b7d377e19fd', '9aa93c2e-4292-42b1-adf3-123f0499ad6e', '0ea3e858-546b-4f7c-a810-e68159e2a6d2', 'db1d4913-d982-41c7-9721-bea9761fe9f6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:18 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:18 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (b860d64d-b8f8-4e8d-afaf-98d6ebd783cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416f7c23-671a-491d-9e5d-f289bcad9e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416f7c23-671a-491d-9e5d-f289bcad9e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331672805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ccf4a5-429d-4326-bf2e-aba35d328884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:19Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14751d90-53ce-4ef5-980d-e6d6e71a3fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14751d90-53ce-4ef5-980d-e6d6e71a3fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af965ca6-d6b6-41db-b022-55c92c50afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af965ca6-d6b6-41db-b022-55c92c50afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ccf4a5-429d-4326-bf2e-aba35d328884', 'volume_name': 'volume-f1ccf4a5-429d-4326-bf2e-aba35d328884', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d0e476-0a63-4a0a-8f38-1fcac5d1b50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d0e476-0a63-4a0a-8f38-1fcac5d1b50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b666fd5-e719-4f99-b749-8f7cbd3ca386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:18 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Volume f1ccf4a5-429d-4326-bf2e-aba35d328884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ccf4a5-429d-4326-bf2e-aba35d328884', 'volume_size': 1} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331672805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ccf4a5-429d-4326-bf2e-aba35d328884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b8843e5714b7089130fbb490708fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:19Z,use_quota=True,user_id='d841989a1a654e55b6f25332850f55d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Creating volume f1ccf4a5-429d-4326-bf2e-aba35d328884 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:18 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:18 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.693s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Deleted volume successfully. Jul 08 19:40:18 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 1073741824 Jul 08 19:40:18 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad03cc12-5d63-4153-8c1a-5a443cd2a174 tempest-VolumesActionsTest-1981361108 None] Lock "cinder-d7f183fe-e2a8-4c01-a112-2118922c97f5-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (44fd8d38-e673-4ee2-8adf-6b47e5b52432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b872266-bbdf-4f78-a281-a836c7cae2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b872266-bbdf-4f78-a281-a836c7cae2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-536216237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eee596e-6e7b-42f5-8210-3b7a65934550,host='devstack@QuobyteHD#QuobyteHD',id=7a799826-64e8-4970-baab-7e48152091f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:20Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e),volume_type_id=a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90b1908-4540-429e-8282-56050c419aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90b1908-4540-429e-8282-56050c419aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf1adba-e83a-464a-82ff-84daf0c8bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf1adba-e83a-464a-82ff-84daf0c8bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a799826-64e8-4970-baab-7e48152091f6', 'volume_name': 'volume-7a799826-64e8-4970-baab-7e48152091f6', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eac2ffc-f638-4bf8-b784-027e9e22bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eac2ffc-f638-4bf8-b784-027e9e22bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94eda10-6989-4243-9650-91580e239524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Volume 7a799826-64e8-4970-baab-7e48152091f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a799826-64e8-4970-baab-7e48152091f6', 'volume_size': 1} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:19 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 1073741824" returned: 0 in 0.904s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:19 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 Jul 08 19:40:19 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:20 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884" returned: 0 in 0.681s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9eee596e-6e7b-42f5-8210-3b7a65934550,created_at=2026-07-08T17:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-536216237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eee596e-6e7b-42f5-8210-3b7a65934550,host='devstack@QuobyteHD#QuobyteHD',id=7a799826-64e8-4970-baab-7e48152091f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:20Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e),volume_type_id=a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Creating volume 7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:20 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:20 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 1073741824 Jul 08 19:40:20 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b666fd5-e719-4f99-b749-8f7cbd3ca386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ccf4a5-429d-4326-bf2e-aba35d328884', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecff78a4-967a-4e84-ad2b-ff08050badf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Volume volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 (f1ccf4a5-429d-4326-bf2e-aba35d328884): created successfully Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecff78a4-967a-4e84-ad2b-ff08050badf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Flow 'volume_create_manager' (b860d64d-b8f8-4e8d-afaf-98d6ebd783cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-30a046ac-e98f-4aff-9316-d40b7fc56070 tempest-VolumesActionsTest-1010600651 None] Created volume successfully. Jul 08 19:40:21 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 1073741824" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:21 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 Jul 08 19:40:21 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "cinder-f1ccf4a5-429d-4326-bf2e-aba35d328884-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f1ccf4a5-429d-4326-bf2e-aba35d328884-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "cinder-quobyte-f1ccf4a5-429d-4326-bf2e-aba35d328884" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-quobyte-f1ccf4a5-429d-4326-bf2e-aba35d328884" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9983ba-909a-4a25-9719-b0eeeabd42fc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:21 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 Jul 08 19:40:21 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:22 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6" returned: 0 in 0.672s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94eda10-6989-4243-9650-91580e239524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a799826-64e8-4970-baab-7e48152091f6', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d9930d-adf3-4827-aba9-9c647153217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Volume volume-7a799826-64e8-4970-baab-7e48152091f6 (7a799826-64e8-4970-baab-7e48152091f6): created successfully Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d9930d-adf3-4827-aba9-9c647153217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (44fd8d38-e673-4ee2-8adf-6b47e5b52432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-40dca87a-9c4a-4a53-818f-636bf08563d9 tempest-GroupSnapshotsTest-357969510 None] Created volume successfully. Jul 08 19:40:22 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884" returned: 0 in 0.827s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:22 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884 Jul 08 19:40:22 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:23 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1ccf4a5-429d-4326-bf2e-aba35d328884" returned: 0 in 0.713s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-quobyte-f1ccf4a5-429d-4326-bf2e-aba35d328884" released by "delete_volume" :: held 1.591s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Created reservations ['84ebca39-bd0c-4b47-9b35-d9ed11f12855', '7a0c48fc-be14-4420-b731-985424ad10b7', '20bbdfd8-0198-4a83-9ed2-5ab8d0506c22', 'e11b66cf-ca45-419b-a679-eae6cd8c5b72'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:23 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:23 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (375567ed-4945-47ab-b31c-6d1034bc9c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c7f994-0f91-4e66-a44a-1c77ccc243ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c7f994-0f91-4e66-a44a-1c77ccc243ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981176931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eee596e-6e7b-42f5-8210-3b7a65934550,host='devstack@QuobyteHD#QuobyteHD',id=062a6d03-f79a-4050-a249-24895534c408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:24Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e),volume_type_id=a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8dbe15-c21e-40d7-bfcc-e29a3b25cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8dbe15-c21e-40d7-bfcc-e29a3b25cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75345792-43a0-401b-b12a-de2d4ae4de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75345792-43a0-401b-b12a-de2d4ae4de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062a6d03-f79a-4050-a249-24895534c408', 'volume_name': 'volume-062a6d03-f79a-4050-a249-24895534c408', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74a8635-02fe-4230-b3f9-f817cb6eb43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74a8635-02fe-4230-b3f9-f817cb6eb43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679f7d56-9caa-488b-b7d2-fe5d90711cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:23 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Volume 062a6d03-f79a-4050-a249-24895534c408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062a6d03-f79a-4050-a249-24895534c408', 'volume_size': 1} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9eee596e-6e7b-42f5-8210-3b7a65934550,created_at=2026-07-08T17:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981176931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eee596e-6e7b-42f5-8210-3b7a65934550,host='devstack@QuobyteHD#QuobyteHD',id=062a6d03-f79a-4050-a249-24895534c408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:24Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e),volume_type_id=a9ce7b35-3c1d-4977-9dd3-fcecd4a2671e)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Creating volume 062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:23 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:23 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 1073741824 Jul 08 19:40:23 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:24 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Deleted volume successfully. Jul 08 19:40:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-40494bf4-4fd3-4d81-91bb-74527d793557 tempest-VolumesActionsTest-1010600651 None] Lock "cinder-f1ccf4a5-429d-4326-bf2e-aba35d328884-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:25 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 1073741824" returned: 0 in 1.150s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:25 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 Jul 08 19:40:25 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:25 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408" returned: 0 in 0.816s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679f7d56-9caa-488b-b7d2-fe5d90711cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062a6d03-f79a-4050-a249-24895534c408', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a61e40-1a98-4d72-a4ea-6a97f1bd2485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Volume volume-062a6d03-f79a-4050-a249-24895534c408 (062a6d03-f79a-4050-a249-24895534c408): created successfully Jul 08 19:40:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a61e40-1a98-4d72-a4ea-6a97f1bd2485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (375567ed-4945-47ab-b31c-6d1034bc9c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c1d9b60b-b3d1-4390-b9a3-05ffb20924ca tempest-GroupSnapshotsTest-357969510 None] Created volume successfully. Jul 08 19:40:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2c46a591-857c-40ba-ae4e-fe286a68d052 tempest-GroupSnapshotsTest-357969510 None] Update group completed successfully. Jul 08 19:40:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d7fe0644-9e59-4e82-8a46-de03c3c7e4a0 tempest-GroupSnapshotsTest-357969510 None] Update group completed successfully. Jul 08 19:40:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ecd93720-eace-429d-8f43-5ad6e0cfbc9d tempest-GroupSnapshotsTest-357969510 None] Update group completed successfully. Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Flow 'volume_create_manager' (ca1f7eb8-a392-4463-9ae4-4d11cdb22629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159303b6-8343-429e-91f6-5c732556a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159303b6-8343-429e-91f6-5c732556a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1689110172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16aad978-d78d-4a8f-b2c2-184f91f464f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b7724124ce4a5ba12807f161946bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:29Z,use_quota=True,user_id='b69ebdfe6cab49fba920a0014f8df6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ed2104-8275-44c1-927c-1d07c81e5a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ed2104-8275-44c1-927c-1d07c81e5a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4506bc-3962-4c44-82f6-d98d168ed028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4506bc-3962-4c44-82f6-d98d168ed028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16aad978-d78d-4a8f-b2c2-184f91f464f0', 'volume_name': 'volume-16aad978-d78d-4a8f-b2c2-184f91f464f0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cea724-ba5f-47b4-9e32-46f1a2b5be1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cea724-ba5f-47b4-9e32-46f1a2b5be1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc50d2-17c5-4a2f-bbf0-3d873cb3aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:29 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Volume 16aad978-d78d-4a8f-b2c2-184f91f464f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16aad978-d78d-4a8f-b2c2-184f91f464f0', 'volume_size': 1} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1689110172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16aad978-d78d-4a8f-b2c2-184f91f464f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b7724124ce4a5ba12807f161946bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:29Z,use_quota=True,user_id='b69ebdfe6cab49fba920a0014f8df6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Creating volume 16aad978-d78d-4a8f-b2c2-184f91f464f0 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:29 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:29 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 1073741824 Jul 08 19:40:29 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b988028c-108f-4e30-9b10-95f2fc52313f tempest-GroupSnapshotsTest-357969510 None] Update group completed successfully. Jul 08 19:40:30 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 1073741824" returned: 0 in 1.054s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:30 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 Jul 08 19:40:30 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:31 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0" returned: 0 in 0.718s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc50d2-17c5-4a2f-bbf0-3d873cb3aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16aad978-d78d-4a8f-b2c2-184f91f464f0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a03726-c9cb-4bf8-8544-2bb4115dc6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Volume volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 (16aad978-d78d-4a8f-b2c2-184f91f464f0): created successfully Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a03726-c9cb-4bf8-8544-2bb4115dc6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Flow 'volume_create_manager' (ca1f7eb8-a392-4463-9ae4-4d11cdb22629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:31 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef0e71f1-398a-4c50-ad7a-23752d4ee5b5 tempest-AttachVolumeTestJSON-688216625 None] Created volume successfully. Jul 08 19:40:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] GroupSnapshot f0883dab-2dc1-4394-ba10-a3c41c998fba: creating. Jul 08 19:40:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Group snapshot f0883dab-2dc1-4394-ba10-a3c41c998fba: creating. {{(pid=87172) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}} Jul 08 19:40:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Creating offline snapshot 330d9894-0f96-468f-8f1e-899f5b97e04d of volume 7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:40:32 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca0ce9-6097-41a1-a475-7e8abe4754b7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:32 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 Jul 08 19:40:32 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:33 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6" returned: 0 in 0.908s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:33 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d 1G Jul 08 19:40:33 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:34 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d 1G" returned: 0 in 1.007s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a799826-64e8-4970-baab-7e48152091f6 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:34 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a799826-64e8-4970-baab-7e48152091f6 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d Jul 08 19:40:34 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:34 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:34 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:34 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a799826-64e8-4970-baab-7e48152091f6 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d" returned: 0 in 0.838s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:34 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:34 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d Jul 08 19:40:34 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:35 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.864s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 8 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:40:35 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:35 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info Jul 08 19:40:35 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:36 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:36 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:40:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:36 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info Jul 08 19:40:36 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:37 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.info" returned: 0 in 0.675s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.210s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Creating offline snapshot e3f24728-045e-430b-902d-b1545eb7c154 of volume 062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2808ce-0517-4ecd-ae5c-0201f3c5f767]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:37 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 Jul 08 19:40:37 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:38 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408" returned: 0 in 0.856s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:38 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 1G Jul 08 19:40:38 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Flow 'volume_create_manager' (a34df6c2-0b35-44ca-ad96-e6bb37c93e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca300c47-4348-428e-b9e0-d27cbdddb507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca300c47-4348-428e-b9e0-d27cbdddb507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-683443686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cfa8cb-f05b-448c-b99a-806a777ea292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a917a0f9da4481e88e5d3c923b43564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:39Z,use_quota=True,user_id='c3dc95fcb03f40eaa56f50baca93e2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29d256c-466e-4a98-980a-767861e1d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29d256c-466e-4a98-980a-767861e1d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ac215b-8697-4584-aabc-fa33f011de5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ac215b-8697-4584-aabc-fa33f011de5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cfa8cb-f05b-448c-b99a-806a777ea292', 'volume_name': 'volume-41cfa8cb-f05b-448c-b99a-806a777ea292', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3653eac9-ed4b-4c37-b9dd-318712332207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3653eac9-ed4b-4c37-b9dd-318712332207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f8aacb-e5a5-47fc-a5fd-b6a793f948e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:38 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Volume 41cfa8cb-f05b-448c-b99a-806a777ea292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cfa8cb-f05b-448c-b99a-806a777ea292', 'volume_size': 1} Jul 08 19:40:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:39 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 1G" returned: 0 in 0.923s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062a6d03-f79a-4050-a249-24895534c408 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:39 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062a6d03-f79a-4050-a249-24895534c408 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 Jul 08 19:40:39 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:39 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062a6d03-f79a-4050-a249-24895534c408 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154" returned: 0 in 0.825s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:39 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:40:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:39 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 Jul 08 19:40:39 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:40 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154" returned: 0 in 0.696s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:40 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info Jul 08 19:40:40 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:41 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info" returned: 0 in 0.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:41 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:40:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:41 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info Jul 08 19:40:41 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:42 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.info" returned: 0 in 0.701s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.193s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[74feca9e-8194-4699-94e1-8becce27e2db]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:42 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 Jul 08 19:40:42 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:42 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6371c80d-e2cc-4273-93b9-9fdcf570e954 tempest-GroupSnapshotsTest-357969510 None] group_snapshot f0883dab-2dc1-4394-ba10-a3c41c998fba: created successfully Jul 08 19:40:42 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] group_snapshot f0883dab-2dc1-4394-ba10-a3c41c998fba: deleting Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] group_snapshot f0883dab-2dc1-4394-ba10-a3c41c998fba: deleting {{(pid=87172) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-7a799826-64e8-4970-baab-7e48152091f6" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-7a799826-64e8-4970-baab-7e48152091f6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-330d9894-0f96-468f-8f1e-899f5b97e04d" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:43 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0" returned: 0 in 0.958s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.987s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.187s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-683443686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cfa8cb-f05b-448c-b99a-806a777ea292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a917a0f9da4481e88e5d3c923b43564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:39Z,use_quota=True,user_id='c3dc95fcb03f40eaa56f50baca93e2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Creating volume 41cfa8cb-f05b-448c-b99a-806a777ea292 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:43 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-330d9894-0f96-468f-8f1e-899f5b97e04d" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:43 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 1073741824 Jul 08 19:40:43 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Deleting offline snapshot 330d9894-0f96-468f-8f1e-899f5b97e04d of volume 7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] snapshot_file for this snap is: volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd5dfd-fa89-405c-b14a-e16465c462e8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-16aad978-d78d-4a8f-b2c2-184f91f464f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39ff39ca-da18-4a30-81bd-6775da34ecfb', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:40:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-fe9b930b-a9a9-484f-88fe-a6a3b6c51f59 req-8c9a0793-b05a-412c-a148-65ded8403de0 tempest-AttachVolumeTestJSON-688216625 None] attachment_update completed successfully. Jul 08 19:40:43 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d Jul 08 19:40:43 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:44 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 1073741824" returned: 0 in 1.130s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:44 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d" returned: 0 in 1.040s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a799826-64e8-4970-baab-7e48152091f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:40:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ccc7b9-9d98-4458-8922-54fe43f81b9b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:44 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 Jul 08 19:40:44 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:44 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 Jul 08 19:40:44 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:45 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292" returned: 0 in 0.853s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f8aacb-e5a5-47fc-a5fd-b6a793f948e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cfa8cb-f05b-448c-b99a-806a777ea292', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b0c772-055f-4ec1-8b5a-2e828242e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Volume volume-41cfa8cb-f05b-448c-b99a-806a777ea292 (41cfa8cb-f05b-448c-b99a-806a777ea292): created successfully Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b0c772-055f-4ec1-8b5a-2e828242e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Flow 'volume_create_manager' (a34df6c2-0b35-44ca-ad96-e6bb37c93e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:45 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-498b670c-6288-4d07-8a75-d201cc99ccb1 tempest-VolumesListAdminTestJSON-1993142378 None] Created volume successfully. Jul 08 19:40:45 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6" returned: 0 in 1.010s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:45 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d Jul 08 19:40:45 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Flow 'volume_create_manager' (19511f27-61e9-458e-8821-29f3afbd5e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454de3aa-9ab0-47a0-a6ae-55bcae98272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:46 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454de3aa-9ab0-47a0-a6ae-55bcae98272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1742117746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35aa766-b339-432c-ad1d-2288743645a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a917a0f9da4481e88e5d3c923b43564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:46Z,use_quota=True,user_id='c3dc95fcb03f40eaa56f50baca93e2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a97342-c96c-4479-91f2-b46022dfad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a97342-c96c-4479-91f2-b46022dfad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a061a5-7906-4f01-bb48-3da5dabbbc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a061a5-7906-4f01-bb48-3da5dabbbc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35aa766-b339-432c-ad1d-2288743645a0', 'volume_name': 'volume-f35aa766-b339-432c-ad1d-2288743645a0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf678f7e-5bb1-484a-88cd-e2b724310e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf678f7e-5bb1-484a-88cd-e2b724310e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63777ef5-1319-4126-956a-6e29e70a8bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Volume f35aa766-b339-432c-ad1d-2288743645a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35aa766-b339-432c-ad1d-2288743645a0', 'volume_size': 1} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1742117746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35aa766-b339-432c-ad1d-2288743645a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a917a0f9da4481e88e5d3c923b43564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:46Z,use_quota=True,user_id='c3dc95fcb03f40eaa56f50baca93e2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Creating volume f35aa766-b339-432c-ad1d-2288743645a0 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:46 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d" returned: 0 in 1.151s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:46 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 1073741824 Jul 08 19:40:46 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:46 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d Jul 08 19:40:46 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:47 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6.330d9894-0f96-468f-8f1e-899f5b97e04d" returned: 0 in 0.808s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-330d9894-0f96-468f-8f1e-899f5b97e04d" released by "_delete_snapshot" :: held 4.185s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-7a799826-64e8-4970-baab-7e48152091f6" released by "delete_snapshot" :: held 4.245s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-062a6d03-f79a-4050-a249-24895534c408" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-062a6d03-f79a-4050-a249-24895534c408" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-e3f24728-045e-430b-902d-b1545eb7c154" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-e3f24728-045e-430b-902d-b1545eb7c154" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Deleting offline snapshot e3f24728-045e-430b-902d-b1545eb7c154 of volume 062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] snapshot_file for this snap is: volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e7e7f6-5f1d-492a-97e1-fc0fb8622266]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:47 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 1073741824" returned: 0 in 1.009s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:47 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 Jul 08 19:40:47 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:47 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 Jul 08 19:40:47 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:48 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0" returned: 0 in 0.740s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63777ef5-1319-4126-956a-6e29e70a8bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35aa766-b339-432c-ad1d-2288743645a0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fc6e1a-30e6-422d-a7f7-e5bd4f4b2d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Volume volume-f35aa766-b339-432c-ad1d-2288743645a0 (f35aa766-b339-432c-ad1d-2288743645a0): created successfully Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fc6e1a-30e6-422d-a7f7-e5bd4f4b2d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Flow 'volume_create_manager' (19511f27-61e9-458e-8821-29f3afbd5e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f6154ee8-8429-46de-adfb-2599bf19c677 tempest-VolumesListAdminTestJSON-1993142378 None] Created volume successfully. Jul 08 19:40:48 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154" returned: 0 in 1.002s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-062a6d03-f79a-4050-a249-24895534c408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1253e-41c9-4f67-a3f4-99a383b52ae0]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:48 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 Jul 08 19:40:48 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:49 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:49 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:49 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Flow 'volume_create_manager' (d5ed433d-3d20-4430-b1ba-ed51565b8b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b76473-07cf-4f0b-96be-eddb743f1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b76473-07cf-4f0b-96be-eddb743f1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1048697042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2d6281-08ea-4bf9-8aff-84ca89b25bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b7724124ce4a5ba12807f161946bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:49Z,use_quota=True,user_id='b69ebdfe6cab49fba920a0014f8df6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2061a4be-9a25-4621-9cf5-053c4761f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2061a4be-9a25-4621-9cf5-053c4761f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d50222b-afe8-450c-8347-b81b20d50dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d50222b-afe8-450c-8347-b81b20d50dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2d6281-08ea-4bf9-8aff-84ca89b25bdb', 'volume_name': 'volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e919f4ba-5d6f-490d-ac7f-e9e768691636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e919f4ba-5d6f-490d-ac7f-e9e768691636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4c6b53-e062-4063-b63a-01e0c227eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:49 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Volume 6d2d6281-08ea-4bf9-8aff-84ca89b25bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb', 'volume_size': 1} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1048697042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2d6281-08ea-4bf9-8aff-84ca89b25bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b7724124ce4a5ba12807f161946bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:49Z,use_quota=True,user_id='b69ebdfe6cab49fba920a0014f8df6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Creating volume 6d2d6281-08ea-4bf9-8aff-84ca89b25bdb {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:49 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:49 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb 1073741824 Jul 08 19:40:49 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Flow 'volume_create_manager' (98f0c775-1a3b-40fc-9c3b-9f7f2098020e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915de739-b527-4ed1-a7c2-80bd55e7b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915de739-b527-4ed1-a7c2-80bd55e7b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-413311359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4707e4b2-35a3-420b-8a50-52413896a4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a917a0f9da4481e88e5d3c923b43564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:50Z,use_quota=True,user_id='c3dc95fcb03f40eaa56f50baca93e2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb0fc23-1d34-428b-92f9-2e2f99303cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb0fc23-1d34-428b-92f9-2e2f99303cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b695a9c-a373-40c6-8e1e-4c3092b52cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b695a9c-a373-40c6-8e1e-4c3092b52cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4707e4b2-35a3-420b-8a50-52413896a4c8', 'volume_name': 'volume-4707e4b2-35a3-420b-8a50-52413896a4c8', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec21256-8f45-4539-a38f-5f5cf31a6924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec21256-8f45-4539-a38f-5f5cf31a6924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff66169-9ac0-492f-98ec-554238c40d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:50 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Volume 4707e4b2-35a3-420b-8a50-52413896a4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4707e4b2-35a3-420b-8a50-52413896a4c8', 'volume_size': 1} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:50 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154" returned: 0 in 1.037s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:50 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154 Jul 08 19:40:50 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:50 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb 1073741824" returned: 0 in 1.116s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:50 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb Jul 08 19:40:50 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:51 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408.e3f24728-045e-430b-902d-b1545eb7c154" returned: 0 in 0.686s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-e3f24728-045e-430b-902d-b1545eb7c154" released by "_delete_snapshot" :: held 3.739s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-062a6d03-f79a-4050-a249-24895534c408" released by "delete_snapshot" :: held 3.767s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:51 devstack cinder-volume[87172]: WARNING cinder.quota [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2064917221 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2064917221, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:40:51 devstack cinder-volume[87172]: WARNING cinder.quota [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2064917221 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2064917221, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Created reservations ['2382fa50-2a97-4964-b6a6-c88bdce4f604', '3b811ca4-c401-44ff-ae81-216d1e77c3af', 'ee4a85a7-ace6-4945-a991-e1063f983ae9', '678c4d56-c4e2-4c4f-a314-741e445831b5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:51 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" returned: 0 in 0.684s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-413311359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4707e4b2-35a3-420b-8a50-52413896a4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a917a0f9da4481e88e5d3c923b43564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:50Z,use_quota=True,user_id='c3dc95fcb03f40eaa56f50baca93e2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Creating volume 4707e4b2-35a3-420b-8a50-52413896a4c8 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:51 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:51 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 1073741824 Jul 08 19:40:51 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4c6b53-e062-4063-b63a-01e0c227eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e6a96f-d379-4280-8565-b6d91c55b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:51 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Volume volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb (6d2d6281-08ea-4bf9-8aff-84ca89b25bdb): created successfully Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e6a96f-d379-4280-8565-b6d91c55b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Flow 'volume_create_manager' (d5ed433d-3d20-4430-b1ba-ed51565b8b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:51 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] Created reservations ['08618230-32e5-4ab1-af90-8a6a605d85a8', '341e7981-77f9-4c1f-ad2c-4713e5e04651', '0266fe4b-385e-4630-a6e5-0d7ffa1d490b', '75e1b187-a302-47ec-8ecc-b54c96af991a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e790fbfb-65bc-4fcc-a0fb-d1aaa1689de0 tempest-AttachVolumeTestJSON-688216625 None] Created volume successfully. Jul 08 19:40:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dba27ec6-8d4d-4e9a-833e-400c2dba3cda tempest-GroupSnapshotsTest-357969510 None] group_snapshot f0883dab-2dc1-4394-ba10-a3c41c998fba: deleted successfully Jul 08 19:40:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-062a6d03-f79a-4050-a249-24895534c408" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-062a6d03-f79a-4050-a249-24895534c408" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:52 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b529d5-89df-442a-8bec-612d504dde1e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:52 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 1073741824" returned: 0 in 1.092s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:52 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 Jul 08 19:40:52 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:52 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 Jul 08 19:40:52 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:53 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff66169-9ac0-492f-98ec-554238c40d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4707e4b2-35a3-420b-8a50-52413896a4c8', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9df4eb-c075-460e-bf17-d7641a94d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Volume volume-4707e4b2-35a3-420b-8a50-52413896a4c8 (4707e4b2-35a3-420b-8a50-52413896a4c8): created successfully Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9df4eb-c075-460e-bf17-d7641a94d30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Flow 'volume_create_manager' (98f0c775-1a3b-40fc-9c3b-9f7f2098020e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-181ae7ff-a312-4dff-b5dd-59af7f718da3 tempest-VolumesListAdminTestJSON-1993142378 None] Created volume successfully. Jul 08 19:40:53 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408" returned: 0 in 1.116s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:53 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408 Jul 08 19:40:53 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:54 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-062a6d03-f79a-4050-a249-24895534c408" returned: 0 in 0.651s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-062a6d03-f79a-4050-a249-24895534c408" released by "delete_volume" :: held 1.854s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-7a799826-64e8-4970-baab-7e48152091f6" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-7a799826-64e8-4970-baab-7e48152091f6" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17158f-dc09-4eea-ba3e-a327c7118a29]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:54 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 Jul 08 19:40:54 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:55 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6" returned: 0 in 0.929s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:55 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6 Jul 08 19:40:55 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Flow 'volume_create_manager' (84f5ac99-b8a7-4784-aa5b-1d3578f3a28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bec7189-0610-4b71-8f9b-a047d8a4eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bec7189-0610-4b71-8f9b-a047d8a4eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8727d96-1a0e-4116-b5fc-319af86c3b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa02c1bbd2a4b1095ed81541a466c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:56Z,use_quota=True,user_id='1fc889e7c8fc4e9e8781f32036ff3786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd6087d-fc08-4b92-88e0-3f4b640672b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd6087d-fc08-4b92-88e0-3f4b640672b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b07c6d9-2fe0-47f3-84c5-8078ea2fae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b07c6d9-2fe0-47f3-84c5-8078ea2fae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8727d96-1a0e-4116-b5fc-319af86c3b6f', 'volume_name': 'volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716194c7-b04e-4754-b2ff-1741a9968b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716194c7-b04e-4754-b2ff-1741a9968b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffa0954-22d1-4a62-8cfc-88ba2ceead5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Volume f8727d96-1a0e-4116-b5fc-319af86c3b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f', 'volume_size': 1} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8727d96-1a0e-4116-b5fc-319af86c3b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa02c1bbd2a4b1095ed81541a466c2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:40:56Z,use_quota=True,user_id='1fc889e7c8fc4e9e8781f32036ff3786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Creating volume f8727d96-1a0e-4116-b5fc-319af86c3b6f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:40:55 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:55 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f 1073741824 Jul 08 19:40:55 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:55 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7a799826-64e8-4970-baab-7e48152091f6" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-7a799826-64e8-4970-baab-7e48152091f6" released by "delete_volume" :: held 1.825s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Created reservations ['20f99f6f-98db-4e66-be2c-edc2858c9278'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:56 devstack cinder-volume[87172]: WARNING cinder.quota [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2064917221 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2064917221, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Created reservations ['878fe62b-9b64-4229-a9b2-1f25b915e382', '7dbd448f-02f5-4d8a-aee3-81260e7819b1', 'b44919f2-66df-4ba3-b3ca-a39fca5523b6', 'ba775194-83f2-472d-9f3a-1be15434a276'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Created reservations ['f840277a-6d59-45b4-b021-af9649feef6f', '8163b297-376a-4add-80c0-4e003390ecba', 'ab127ced-794b-4257-81e8-80d47b40f319', '276234b8-466e-4960-8b4e-2897389ca080'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:56 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:40:56 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:56 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f 1073741824" returned: 0 in 0.984s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:56 devstack sudo[97657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f Jul 08 19:40:56 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:57 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:40:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d141e0f4-8403-4ddd-b236-d4f51035939c tempest-GroupSnapshotsTest-357969510 None] Delete group completed successfully. Jul 08 19:40:57 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.735s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ffa0954-22d1-4a62-8cfc-88ba2ceead5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f2bf9-36a5-4913-8af8-ece0811d4455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42355a-d0e9-4fc7-a213-c7c058f46c31]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:57 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Volume volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f (f8727d96-1a0e-4116-b5fc-319af86c3b6f): created successfully Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f2bf9-36a5-4913-8af8-ece0811d4455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Flow 'volume_create_manager' (84f5ac99-b8a7-4784-aa5b-1d3578f3a28b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef6949bb-4f9d-4b8b-8163-c1162ba65c36 tempest-VolumesListAdminTestJSON-2037979145 None] Created volume successfully. Jul 08 19:40:57 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb Jul 08 19:40:57 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-54887638-7c14-4bc1-ab1d-257c80e0aeab tempest-GroupSnapshotsTest-357969510 None] Group tempest-GroupSnapshotsTest-Group-1104959141: creating Jul 08 19:40:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-54887638-7c14-4bc1-ab1d-257c80e0aeab tempest-GroupSnapshotsTest-357969510 None] Group tempest-GroupSnapshotsTest-Group-1104959141: created successfully Jul 08 19:40:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-54887638-7c14-4bc1-ab1d-257c80e0aeab tempest-GroupSnapshotsTest-357969510 None] Create group completed successfully. Jul 08 19:40:58 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 08 19:40:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" returned: 0 in 0.974s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:40:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.021s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:40:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30d9c9c6-a547-40c9-a838-d56ed2ce0ddb', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:40:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-8d18914f-b2f8-4ead-a0bc-d8d9e4c48f0a req-663b0850-b5da-43ee-87a2-8d6e1db47c7a tempest-AttachVolumeTestJSON-688216625 None] attachment_update completed successfully. Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Acquiring lock "cinder-f8727d96-1a0e-4116-b5fc-319af86c3b6f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Lock "cinder-f8727d96-1a0e-4116-b5fc-319af86c3b6f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Acquiring lock "cinder-quobyte-f8727d96-1a0e-4116-b5fc-319af86c3b6f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Lock "cinder-quobyte-f8727d96-1a0e-4116-b5fc-319af86c3b6f" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[058990e0-98cd-4724-aebe-c3a21679f552]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "cinder-4707e4b2-35a3-420b-8a50-52413896a4c8-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-4707e4b2-35a3-420b-8a50-52413896a4c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "cinder-quobyte-4707e4b2-35a3-420b-8a50-52413896a4c8" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:40:59 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f Jul 08 19:40:59 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-quobyte-4707e4b2-35a3-420b-8a50-52413896a4c8" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e7ec6-f2a9-412a-8b17-831bd34d5891]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:40:59 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 Jul 08 19:40:59 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (b54e7415-bf31-449f-a89e-0ce5fbe74aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6677ad5e-3f41-4c47-8223-a6ebc59ae33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6677ad5e-3f41-4c47-8223-a6ebc59ae33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1826906094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=124613fa-37cf-4912-8bbe-bf71f7003cb7,host='devstack@QuobyteHD#QuobyteHD',id=56ab6471-82fd-4132-8d25-26bd1a272656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:00Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0fb7c83-a525-4537-b4f9-8785c4cdd34c),volume_type_id=c0fb7c83-a525-4537-b4f9-8785c4cdd34c)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d74b7f-7585-41df-9736-673d064b34fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d74b7f-7585-41df-9736-673d064b34fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:40:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d16200-b899-4f14-999a-6046825f6211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d16200-b899-4f14-999a-6046825f6211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ab6471-82fd-4132-8d25-26bd1a272656', 'volume_name': 'volume-56ab6471-82fd-4132-8d25-26bd1a272656', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba523967-73fe-4257-a20d-df526506cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba523967-73fe-4257-a20d-df526506cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048c3776-09f3-439b-b43b-62d7b24dc04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Volume 56ab6471-82fd-4132-8d25-26bd1a272656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ab6471-82fd-4132-8d25-26bd1a272656', 'volume_size': 1} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=124613fa-37cf-4912-8bbe-bf71f7003cb7,created_at=2026-07-08T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1826906094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=124613fa-37cf-4912-8bbe-bf71f7003cb7,host='devstack@QuobyteHD#QuobyteHD',id=56ab6471-82fd-4132-8d25-26bd1a272656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06cb63b2b6640ecbd3acd991b1dc2e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:00Z,use_quota=True,user_id='9f08e49680ae4455a4c3ecb2b7272b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0fb7c83-a525-4537-b4f9-8785c4cdd34c),volume_type_id=c0fb7c83-a525-4537-b4f9-8785c4cdd34c)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Creating volume 56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:41:00 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:00 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 1073741824 Jul 08 19:41:00 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:00 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f" returned: 0 in 1.114s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:00 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f Jul 08 19:41:00 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:00 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8" returned: 0 in 1.029s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:00 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8 Jul 08 19:41:00 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:01 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 1073741824" returned: 0 in 1.236s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:01 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4707e4b2-35a3-420b-8a50-52413896a4c8" returned: 0 in 0.878s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-quobyte-4707e4b2-35a3-420b-8a50-52413896a4c8" released by "delete_volume" :: held 1.977s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:01 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f8727d96-1a0e-4116-b5fc-319af86c3b6f" returned: 0 in 1.089s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:01 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 Jul 08 19:41:01 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Lock "cinder-quobyte-f8727d96-1a0e-4116-b5fc-319af86c3b6f" released by "delete_volume" :: held 2.273s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Created reservations ['def32424-9100-4fc2-bf2c-32a97ca69038', '1844af08-a41e-4825-bfdb-9c87234a7d56', '8f36eccc-442e-4760-9519-7dceaca915be', 'ff0891c4-46a0-417c-ae8a-5bdabff6c85b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Created reservations ['03795950-5a91-4c4d-b3ad-a6d676dfcf2b', '722c745f-9c98-4818-9d5b-6b3891b37ac4', '24513a6f-e634-4c8d-9807-28f1b723e839', 'acabd61c-1fb6-4434-b6e9-8436926a7264'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:01 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:01 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:01 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:01 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:02 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656" returned: 0 in 0.834s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048c3776-09f3-439b-b43b-62d7b24dc04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ab6471-82fd-4132-8d25-26bd1a272656', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455b5169-4dfd-4b9d-ab2a-b97c275f1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:02 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Volume volume-56ab6471-82fd-4132-8d25-26bd1a272656 (56ab6471-82fd-4132-8d25-26bd1a272656): created successfully Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455b5169-4dfd-4b9d-ab2a-b97c275f1773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Flow 'volume_create_manager' (b54e7415-bf31-449f-a89e-0ce5fbe74aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-72455ea0-2d4b-4ea9-a542-8ad6ca645c2f tempest-GroupSnapshotsTest-357969510 None] Created volume successfully. Jul 08 19:41:02 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.863s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Deleted volume successfully. Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b5393fff-a3de-4292-84d4-804f4fd981ed tempest-VolumesListAdminTestJSON-2037979145 None] Lock "cinder-f8727d96-1a0e-4116-b5fc-319af86c3b6f-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:02 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.997s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Deleted volume successfully. Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8ad51974-831d-4c79-91ea-9175914accb8 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-4707e4b2-35a3-420b-8a50-52413896a4c8-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "cinder-f35aa766-b339-432c-ad1d-2288743645a0-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-f35aa766-b339-432c-ad1d-2288743645a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] GroupSnapshot 66ad272b-a4d2-4fa7-85a3-c33604fc8271: creating. Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "cinder-quobyte-f35aa766-b339-432c-ad1d-2288743645a0" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Group snapshot 66ad272b-a4d2-4fa7-85a3-c33604fc8271: creating. {{(pid=87172) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4185}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-quobyte-f35aa766-b339-432c-ad1d-2288743645a0" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Creating offline snapshot 360b21fd-e0d7-4c80-b69d-8567ce1bd173 of volume 56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c29ddb-c042-4ea8-a2ca-06b328634508]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[76da0430-31a9-413f-91a3-c26088ee20e5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:03 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 Jul 08 19:41:03 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:03 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 Jul 08 19:41:03 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:03 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0" returned: 0 in 0.885s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:03 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656" returned: 0 in 0.914s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:03 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0 Jul 08 19:41:03 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:03 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 1G Jul 08 19:41:03 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Flow 'volume_create_manager' (9ef100f4-052c-47b1-8996-19ed6925acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd2f0a0-1b88-433e-80a5-f534b90ddffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd2f0a0-1b88-433e-80a5-f534b90ddffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-142049452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23837041-5108-4ba4-a30c-320d9e37b050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ef13f702ac4ab6b2d1eb82d7b91b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:04Z,use_quota=True,user_id='feb5c8d0c04040bc8336a492ba7761a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ea30e2-d74e-4d6c-b85f-67bad5664440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ea30e2-d74e-4d6c-b85f-67bad5664440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918622ba-d427-48a2-a8f8-d1978cd65884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:41:04 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f35aa766-b339-432c-ad1d-2288743645a0" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-quobyte-f35aa766-b339-432c-ad1d-2288743645a0" released by "delete_volume" :: held 1.740s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Created reservations ['211a0e2e-1c30-4bf0-81d0-a33f84052510', '2ab6a901-604b-4f0f-820a-5f06126e457b', '29549408-a65f-476a-ae06-94e72e02de9b', '6a96387f-3972-43c6-b3fb-f8e0fccd33e5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:04 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 1G" returned: 0 in 0.889s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ab6471-82fd-4132-8d25-26bd1a272656 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:04 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ab6471-82fd-4132-8d25-26bd1a272656 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 Jul 08 19:41:04 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:04 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:04 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918622ba-d427-48a2-a8f8-d1978cd65884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23837041-5108-4ba4-a30c-320d9e37b050', 'volume_name': 'volume-23837041-5108-4ba4-a30c-320d9e37b050', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bddd700-ffd4-4462-982d-b281045adb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bddd700-ffd4-4462-982d-b281045adb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1628ddfe-5408-49d0-910d-560cf4046b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:04 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Volume 23837041-5108-4ba4-a30c-320d9e37b050: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23837041-5108-4ba4-a30c-320d9e37b050', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 19:41:04 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Trying to clone 23837041-5108-4ba4-a30c-320d9e37b050 from image 35933816-a0eb-45ed-8ba6-853bccb9e496 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "cinder-41cfa8cb-f05b-448c-b99a-806a777ea292-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-41cfa8cb-f05b-448c-b99a-806a777ea292-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-68f4743e-a974-43f8-a30d-6d9369e1b1e7 req-f9b1648b-8912-49ca-9c88-f72092c94dff tempest-AttachVolumeTestJSON-688216625 None] Terminate volume connection completed successfully. Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-68f4743e-a974-43f8-a30d-6d9369e1b1e7 req-f9b1648b-8912-49ca-9c88-f72092c94dff tempest-AttachVolumeTestJSON-688216625 None] Deleting attachment 39ff39ca-da18-4a30-81bd-6775da34ecfb. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "cinder-quobyte-41cfa8cb-f05b-448c-b99a-806a777ea292" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-quobyte-41cfa8cb-f05b-448c-b99a-806a777ea292" acquired by "delete_volume" :: waited 0.035s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[da236615-2101-4a45-964a-8031ef45fce5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:41:05 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Image download 20.69 MB at 20.69 MB/s Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c345cbe4-888b-4920-9a0e-315324030549]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:05 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 Jul 08 19:41:05 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:05 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56ab6471-82fd-4132-8d25-26bd1a272656 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173" returned: 0 in 0.940s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:05 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:05 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.946s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:05 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 Jul 08 19:41:05 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:05 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:05 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Deleted volume successfully. Jul 08 19:41:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-27a7d1ba-a245-47de-9fcb-789c58617b1d tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-f35aa766-b339-432c-ad1d-2288743645a0-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:06 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD" returned: 0 in 0.876s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 is fetched for user feb5c8d0c04040bc8336a492ba7761a2. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:41:06 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292" returned: 0 in 0.998s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:06 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292 Jul 08 19:41:06 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:06 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173" returned: 0 in 0.857s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e683aa-2708-4fa4-a527-b052a56ffa65]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:06 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info Jul 08 19:41:06 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:06 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD Jul 08 19:41:06 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:07 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-41cfa8cb-f05b-448c-b99a-806a777ea292" returned: 0 in 0.689s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-quobyte-41cfa8cb-f05b-448c-b99a-806a777ea292" released by "delete_volume" :: held 1.748s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Created reservations ['16e12842-97a3-4fff-a698-504c2f3fac12', 'f0a06ba6-5275-4794-b3ff-7a2507b32a29', '91a443f2-5e81-4245-a012-53b2b7b8d802', 'd17d37b3-8dd9-4225-9077-ae29280c3ff9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:07 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info" returned: 0 in 0.691s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:07 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:07 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info Jul 08 19:41:07 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:07 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:07 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:07 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-8679eeb0-20cd-435d-b238-47ad3156ff41 req-eddebbf7-7cee-48b4-a122-71c1f4858a3c tempest-AttachVolumeTestJSON-688216625 None] Terminate volume connection completed successfully. Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-8679eeb0-20cd-435d-b238-47ad3156ff41 req-eddebbf7-7cee-48b4-a122-71c1f4858a3c tempest-AttachVolumeTestJSON-688216625 None] Deleting attachment 30d9c9c6-a547-40c9-a838-d56ed2ce0ddb. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:41:07 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.info" returned: 0 in 0.721s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.137s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-142049452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23837041-5108-4ba4-a30c-320d9e37b050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ef13f702ac4ab6b2d1eb82d7b91b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:04Z,use_quota=True,user_id='feb5c8d0c04040bc8336a492ba7761a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Creating volume 23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:41:08 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:08 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 1073741824 Jul 08 19:41:08 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef04c96f-c069-4ab7-b72d-e6f95c9eef09 tempest-GroupSnapshotsTest-357969510 None] group_snapshot 66ad272b-a4d2-4fa7-85a3-c33604fc8271: created successfully Jul 08 19:41:08 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.767s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Deleted volume successfully. Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fed5e961-4310-4f2d-80c2-0e12fa691ea3 tempest-VolumesListAdminTestJSON-1993142378 None] Lock "cinder-41cfa8cb-f05b-448c-b99a-806a777ea292-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] group_snapshot 66ad272b-a4d2-4fa7-85a3-c33604fc8271: deleting Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] group_snapshot 66ad272b-a4d2-4fa7-85a3-c33604fc8271: deleting {{(pid=87172) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4360}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-56ab6471-82fd-4132-8d25-26bd1a272656" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-56ab6471-82fd-4132-8d25-26bd1a272656" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-360b21fd-e0d7-4c80-b69d-8567ce1bd173" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-360b21fd-e0d7-4c80-b69d-8567ce1bd173" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Deleting offline snapshot 360b21fd-e0d7-4c80-b69d-8567ce1bd173 of volume 56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] snapshot_file for this snap is: volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804b1c5-9166-450d-be1e-43a991de9a0c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:08 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 Jul 08 19:41:08 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:09 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 1073741824" returned: 0 in 1.048s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:09 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:41:09 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:09 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173" returned: 0 in 1.001s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56ab6471-82fd-4132-8d25-26bd1a272656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce961b97-d16c-4959-9058-9b8e84eb93d2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:09 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 Jul 08 19:41:09 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:09 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 0.692s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Attempting download of 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume 23837041-5108-4ba4-a30c-320d9e37b050. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00b813-ee58-4cc8-8595-ebf75c0598c3]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_ {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:10 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_ Jul 08 19:41:10 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:10 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656" returned: 0 in 0.971s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:10 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 Jul 08 19:41:10 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:10 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_" returned: 0 in 1.000s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_ {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:11 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_ Jul 08 19:41:11 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:11 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173" returned: 0 in 0.855s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:11 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173 Jul 08 19:41:11 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:11 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_" returned: 1 in 0.803s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_lw8b_b1_' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:41:11 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e38ed-34f0-4513-9085-64e3bea7b720]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:11 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD Jul 08 19:41:11 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:12 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656.360b21fd-e0d7-4c80-b69d-8567ce1bd173" returned: 0 in 0.747s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-360b21fd-e0d7-4c80-b69d-8567ce1bd173" released by "_delete_snapshot" :: held 3.736s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-56ab6471-82fd-4132-8d25-26bd1a272656" released by "delete_snapshot" :: held 3.773s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:12 devstack cinder-volume[87172]: WARNING cinder.quota [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-709065617 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-709065617, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:41:12 devstack cinder-volume[87172]: WARNING cinder.quota [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-709065617 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-709065617, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['348b5891-5e30-42bb-8c0c-d08d1c0ac9f4', '56c85a44-539e-4698-adc3-8fbd4d469309', '92dab517-b388-4225-a4bb-6e565d2256a2', 'a752c987-90b8-4730-9220-a026f6784eeb'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-00d37bac-1327-406c-a079-defcacec9240 tempest-GroupSnapshotsTest-357969510 None] group_snapshot 66ad272b-a4d2-4fa7-85a3-c33604fc8271: deleted successfully Jul 08 19:41:12 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD" returned: 0 in 0.923s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] 35933816-a0eb-45ed-8ba6-853bccb9e496 was qcow2, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:41:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:12 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:41:12 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Flow 'volume_create_manager' (f3c78abb-5b88-46db-933d-566e47064424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669f4485-6b67-438a-96ba-acc48e21419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669f4485-6b67-438a-96ba-acc48e21419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1692507336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba1c2c-1c62-47fc-b554-ca3876b05709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c752a1e8dd452e87e7df7858f398d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:13Z,use_quota=True,user_id='710310d97454479d9a3025e702db46b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9025b5-a72b-42ae-969e-a005432f6284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c9025b5-a72b-42ae-969e-a005432f6284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74eb7b3e-4eb8-4854-969a-9f3711639692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "cinder-quobyte-56ab6471-82fd-4132-8d25-26bd1a272656" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-56ab6471-82fd-4132-8d25-26bd1a272656" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de4dfd3-d672-47c9-a177-607437ec6464]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74eb7b3e-4eb8-4854-969a-9f3711639692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbba1c2c-1c62-47fc-b554-ca3876b05709', 'volume_name': 'volume-cbba1c2c-1c62-47fc-b554-ca3876b05709', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70833b29-a636-405a-993e-7108bd55f9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70833b29-a636-405a-993e-7108bd55f9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6a0ae-b3d8-451f-bb83-23a2c9e2aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:13 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Volume cbba1c2c-1c62-47fc-b554-ca3876b05709: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbba1c2c-1c62-47fc-b554-ca3876b05709', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 19:41:13 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Trying to clone cbba1c2c-1c62-47fc-b554-ca3876b05709 from image 35933816-a0eb-45ed-8ba6-853bccb9e496 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:41:13 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 Jul 08 19:41:13 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:14 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:41:14 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Image download 20.69 MB at 20.69 MB/s Jul 08 19:41:14 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915450d-f8f8-4dd3-8335-626d26b01328]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:14 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD Jul 08 19:41:14 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:14 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656" returned: 0 in 1.204s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:14 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656 Jul 08 19:41:14 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:15 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 2.519s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_3vvdtpw7devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:41:15 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Converted 112.00 MB image at 44.44 MB/s Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:15 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 1G Jul 08 19:41:15 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:15 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD" returned: 0 in 0.937s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 is fetched for user 710310d97454479d9a3025e702db46b0. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffce4751-f6d3-4c8e-8155-849713001786]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:15 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD Jul 08 19:41:15 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:15 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-56ab6471-82fd-4132-8d25-26bd1a272656" returned: 0 in 0.850s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Lock "cinder-quobyte-56ab6471-82fd-4132-8d25-26bd1a272656" released by "delete_volume" :: held 2.127s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['0edb1163-f6e1-472a-9b5b-f9005333b510'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:15 devstack cinder-volume[87172]: WARNING cinder.quota [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-709065617 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-709065617, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Created reservations ['6c4c366a-f210-4eb7-9d2a-a6a55319cc12', '47bf1f75-1763-4d41-8d82-0a1d6a993d82', 'e166a263-a574-4a60-9d6f-456457124a46', 'a4c094a2-7273-4abe-aa24-d78c19399593'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:15 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:15 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:16 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 1G" returned: 0 in 0.919s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a517f2-b2c7-4322-be67-2566f4229fc5]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:16 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:41:16 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:16 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1692507336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbba1c2c-1c62-47fc-b554-ca3876b05709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c752a1e8dd452e87e7df7858f398d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:13Z,use_quota=True,user_id='710310d97454479d9a3025e702db46b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Creating volume cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:41:16 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:16 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 1073741824 Jul 08 19:41:16 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:16 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:16 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-18c855c0-a197-46aa-a70e-dfa078769439 tempest-GroupSnapshotsTest-357969510 None] Delete group completed successfully. Jul 08 19:41:16 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 0.787s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:17 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:41:17 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:17 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 1073741824" returned: 0 in 0.972s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=141,cinder:UPDATE=146,cinder:INSERT=40,cinder:DELETE=6 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=161,cinder:SELECT=146,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:17 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:17 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:17 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 1 in 0.865s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Downloaded image 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume 23837041-5108-4ba4-a30c-320d9e37b050 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 for user feb5c8d0c04040bc8336a492ba7761a2 is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Marking volume 23837041-5108-4ba4-a30c-320d9e37b050 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Copying metadata from image 35933816-a0eb-45ed-8ba6-853bccb9e496 to 23837041-5108-4ba4-a30c-320d9e37b050. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Creating volume glance metadata for volume 23837041-5108-4ba4-a30c-320d9e37b050 backed by image 35933816-a0eb-45ed-8ba6-853bccb9e496 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1628ddfe-5408-49d0-910d-560cf4046b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23837041-5108-4ba4-a30c-320d9e37b050', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a82248-8525-4796-a46e-69cb9ba9709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Volume volume-23837041-5108-4ba4-a30c-320d9e37b050 (23837041-5108-4ba4-a30c-320d9e37b050): created successfully Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a82248-8525-4796-a46e-69cb9ba9709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Flow 'volume_create_manager' (9ef100f4-052c-47b1-8996-19ed6925acbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3e76ac41-ba02-4d04-b1eb-aa73aef9bfda tempest-TestShelveInstance-2082987520 None] Created volume successfully. Jul 08 19:41:18 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 0 in 0.702s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Attempting download of 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume cbba1c2c-1c62-47fc-b554-ca3876b05709. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[798df4c4-3557-4df2-b2bf-d291d24a9f78]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:18 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc Jul 08 19:41:18 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:18 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc" returned: 0 in 0.853s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:19 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc Jul 08 19:41:19 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "cinder-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "cinder-quobyte-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-quobyte-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[059a5a49-9126-4bfe-8a43-662019e37e15]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:19 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb Jul 08 19:41:19 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:19 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc" returned: 1 in 1.033s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_kbddzkhc' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c6abb5-e473-4e53-afde-cb15dcf45231]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:20 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD Jul 08 19:41:20 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:20 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" returned: 0 in 1.006s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:20 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb Jul 08 19:41:20 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:20 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:20 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] 35933816-a0eb-45ed-8ba6-853bccb9e496 was qcow2, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:41:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:20 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:20 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:21 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" returned: 0 in 0.767s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-quobyte-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb" released by "delete_volume" :: held 1.825s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Created reservations ['be771996-db15-44e6-b356-7f5ca4375148', 'dea15662-1682-4067-af65-469753aef935', '13fa543f-0322-40e3-93de-664d35019027', '01596f7a-a483-4d81-8764-62aaf903a9ce'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:21 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:21 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "cinder-16aad978-d78d-4a8f-b2c2-184f91f464f0-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-16aad978-d78d-4a8f-b2c2-184f91f464f0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "cinder-quobyte-16aad978-d78d-4a8f-b2c2-184f91f464f0" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-quobyte-16aad978-d78d-4a8f-b2c2-184f91f464f0" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a33e427-6fa5-4010-a4c2-f438ea8acf0e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:21 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 Jul 08 19:41:21 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:22 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.967s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:22 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Deleted volume successfully. Jul 08 19:41:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8769f5e7-534f-48cd-968d-b7831171d4e6 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-6d2d6281-08ea-4bf9-8aff-84ca89b25bdb-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:22 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0" returned: 0 in 1.003s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:22 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0 Jul 08 19:41:22 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:23 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 0 in 2.327s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_dayjyxebdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:41:23 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Converted 112.00 MB image at 48.11 MB/s Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:23 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 1G Jul 08 19:41:23 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8a67397a-2602-4da0-a23d-841606a3e34e tempest-GroupsV314Test-483183364 None] Group tempest-GroupsV314Test-Group-788211576: creating Jul 08 19:41:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8a67397a-2602-4da0-a23d-841606a3e34e tempest-GroupsV314Test-483183364 None] Group tempest-GroupsV314Test-Group-788211576: created successfully Jul 08 19:41:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8a67397a-2602-4da0-a23d-841606a3e34e tempest-GroupsV314Test-483183364 None] Create group completed successfully. Jul 08 19:41:23 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-16aad978-d78d-4a8f-b2c2-184f91f464f0" returned: 0 in 0.734s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-quobyte-16aad978-d78d-4a8f-b2c2-184f91f464f0" released by "delete_volume" :: held 1.782s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Created reservations ['5c60c1af-a29b-44e3-88a9-200ecbf4e4c8', '351d787b-26b9-45d7-85a8-189f6f816620', 'c9d94203-a7be-41dc-a72a-0b672ae9bd6c', '0e0b4ded-79ea-4b0b-9187-107927d64efb'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:23 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:23 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "cinder-4129e84f-e6bf-4074-ad30-aff81c2c6b4c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-4129e84f-e6bf-4074-ad30-aff81c2c6b4c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "cinder-quobyte-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-quobyte-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697ce27-3a24-4c3b-b67c-e866f11051fc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:24 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 1G" returned: 0 in 0.816s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbfd3e6-803e-400d-9258-c605f6862d00]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:24 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c Jul 08 19:41:24 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:24 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:24 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:24 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.707s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Deleted volume successfully. Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-34e56cb6-02f4-4806-8e4f-edef63e1be5a tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-16aad978-d78d-4a8f-b2c2-184f91f464f0-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:24 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" returned: 0 in 0.969s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:25 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c Jul 08 19:41:25 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:41:25 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Flow 'volume_create_manager' (f473d2cf-0c48-4810-9278-0a64d014767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e71b1e-0267-4f1d-8e77-08f13b8459d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 0 in 1.104s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e71b1e-0267-4f1d-8e77-08f13b8459d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074465480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10ef7e2f-7694-4dec-a9c4-27a47ced7a19,host='devstack@QuobyteHD#QuobyteHD',id=d04869b8-b702-4663-bd7a-c0644ab940d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed42bdab7ee4fb9bda157c144e052c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:25Z,use_quota=True,user_id='5c72e9dc3cc646af8d346fe0f4749d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1651232-c1d8-4991-bfe3-a1363967608e),volume_type_id=c1651232-c1d8-4991-bfe3-a1363967608e)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f092d4-ba1e-41c5-9a75-589d5e52b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f092d4-ba1e-41c5-9a75-589d5e52b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32222a4-f56f-4a40-9547-a0f2755e30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32222a4-f56f-4a40-9547-a0f2755e30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04869b8-b702-4663-bd7a-c0644ab940d3', 'volume_name': 'volume-d04869b8-b702-4663-bd7a-c0644ab940d3', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b541121e-d67c-4a75-bd0e-f05508ed2757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b541121e-d67c-4a75-bd0e-f05508ed2757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c28abf-ee8d-4f01-a7dc-f015da663d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:25 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Volume d04869b8-b702-4663-bd7a-c0644ab940d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04869b8-b702-4663-bd7a-c0644ab940d3', 'volume_size': 1} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=10ef7e2f-7694-4dec-a9c4-27a47ced7a19,created_at=2026-07-08T17:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074465480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10ef7e2f-7694-4dec-a9c4-27a47ced7a19,host='devstack@QuobyteHD#QuobyteHD',id=d04869b8-b702-4663-bd7a-c0644ab940d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed42bdab7ee4fb9bda157c144e052c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:25Z,use_quota=True,user_id='5c72e9dc3cc646af8d346fe0f4749d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1651232-c1d8-4991-bfe3-a1363967608e),volume_type_id=c1651232-c1d8-4991-bfe3-a1363967608e)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Creating volume d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:41:25 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:25 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:25 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:25 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 1073741824 Jul 08 19:41:25 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:25 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" returned: 0 in 0.805s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-quobyte-4129e84f-e6bf-4074-ad30-aff81c2c6b4c" released by "delete_volume" :: held 1.832s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:25 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Created reservations ['76a84ad5-aff4-4876-b6bd-391d01c42040', 'e88935bb-bfd3-4da8-b7a0-b0b7e60ffe4b', '0cd027a1-8ac7-4425-96cb-b36795d738ee', 'ef4bddc4-47b4-4bff-8981-5bd0f671e86b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:26 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:26 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:26 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 1 in 1.161s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Downloaded image 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume cbba1c2c-1c62-47fc-b554-ca3876b05709 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 for user 710310d97454479d9a3025e702db46b0 is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Marking volume cbba1c2c-1c62-47fc-b554-ca3876b05709 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Copying metadata from image 35933816-a0eb-45ed-8ba6-853bccb9e496 to cbba1c2c-1c62-47fc-b554-ca3876b05709. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Creating volume glance metadata for volume cbba1c2c-1c62-47fc-b554-ca3876b05709 backed by image 35933816-a0eb-45ed-8ba6-853bccb9e496 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:41:26 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 1073741824" returned: 0 in 1.310s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6a0ae-b3d8-451f-bb83-23a2c9e2aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbba1c2c-1c62-47fc-b554-ca3876b05709', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b436f343-5660-4bca-9e37-54c10f7b3022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Volume volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 (cbba1c2c-1c62-47fc-b554-ca3876b05709): created successfully Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b436f343-5660-4bca-9e37-54c10f7b3022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Flow 'volume_create_manager' (f3c78abb-5b88-46db-933d-566e47064424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:26 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:26 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a13a2754-aa3b-4005-b2f4-5b387ce4c804 tempest-VolumesImageMetadata-1038483585 None] Created volume successfully. Jul 08 19:41:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:27 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.142s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Deleted volume successfully. Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6a2f8718-813a-404d-9f65-bad993adb085 tempest-AttachVolumeTestJSON-688216625 None] Lock "cinder-4129e84f-e6bf-4074-ad30-aff81c2c6b4c-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:27 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 0.884s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.823s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c28abf-ee8d-4f01-a7dc-f015da663d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04869b8-b702-4663-bd7a-c0644ab940d3', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266df160-4cba-458a-aeaf-533899693142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc9590-d1c6-46be-9610-fd7c894a889b]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Acquiring lock "cinder-cbba1c2c-1c62-47fc-b554-ca3876b05709-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Volume volume-d04869b8-b702-4663-bd7a-c0644ab940d3 (d04869b8-b702-4663-bd7a-c0644ab940d3): created successfully Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266df160-4cba-458a-aeaf-533899693142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Flow 'volume_create_manager' (f473d2cf-0c48-4810-9278-0a64d014767d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3378b7c4-4f8b-4657-a8bd-71bff451545c tempest-GroupsV314Test-483183364 None] Created volume successfully. Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Lock "cinder-cbba1c2c-1c62-47fc-b554-ca3876b05709-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Acquiring lock "cinder-quobyte-cbba1c2c-1c62-47fc-b554-ca3876b05709" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Lock "cinder-quobyte-cbba1c2c-1c62-47fc-b554-ca3876b05709" acquired by "delete_volume" :: waited 0.031s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:27 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:41:27 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[13af120f-ffc7-4ade-a27b-f4b4b57bb75a]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:28 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:28 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:28 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 1.087s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:28 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:41:28 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:28 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 0 in 1.017s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:29 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:29 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:29 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 1 in 0.923s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.092s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-23837041-5108-4ba4-a30c-320d9e37b050', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ce20a94-f175-4f57-a7d2-09ad4c215bfa', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:41:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-b487c70c-7492-440f-a58a-5a494527637f req-18490370-e5b7-4dff-9653-81a531259ad9 tempest-TestShelveInstance-2082987520 None] attachment_update completed successfully. Jul 08 19:41:29 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 1 in 0.964s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:41:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:29 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709 Jul 08 19:41:29 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:30 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Cloning volume d04869b8-b702-4663-bd7a-c0644ab940d3 to volume 77acde34-46f2-4477-90f2-00e8e73c0a36 Jul 08 19:41:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Creating offline snapshot d69e49a4-1c96-4a70-aed3-ffe7078b13de of volume d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:41:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb6058-ea50-43eb-a5b0-62885908f804]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:30 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:30 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:31 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cbba1c2c-1c62-47fc-b554-ca3876b05709" returned: 0 in 1.110s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Lock "cinder-quobyte-cbba1c2c-1c62-47fc-b554-ca3876b05709" released by "delete_volume" :: held 3.213s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Created reservations ['86324fe2-12e3-476e-b0f3-50d6278923e3', '89a2b909-df2b-4641-9bf9-cde70d39414e', '86cbcba1-f83f-4189-87e7-5afeaebdf81c', 'c708ab68-ef7c-47da-99c7-394ca5e740bd'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:31 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:31 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:31 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 1.189s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:31 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de 1G Jul 08 19:41:31 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:32 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.922s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:32 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Deleted volume successfully. Jul 08 19:41:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fd39d0a3-e1a2-4a2b-8718-c5536173007d tempest-VolumesImageMetadata-1038483585 None] Lock "cinder-cbba1c2c-1c62-47fc-b554-ca3876b05709-delete_volume" released by "delete_volume" :: held 4.408s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:32 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de 1G" returned: 0 in 1.202s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04869b8-b702-4663-bd7a-c0644ab940d3 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:32 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04869b8-b702-4663-bd7a-c0644ab940d3 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de Jul 08 19:41:32 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:34 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04869b8-b702-4663-bd7a-c0644ab940d3 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de" returned: 0 in 1.096s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:34 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:34 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de Jul 08 19:41:34 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:34 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:34 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:35 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de" returned: 0 in 1.188s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:35 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info Jul 08 19:41:35 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:35 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.918s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:41:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:41:36 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info" returned: 0 in 1.046s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:36 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:41:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:36 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info Jul 08 19:41:36 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:37 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.info" returned: 0 in 1.007s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Acquiring lock "cinder-quobyte-77acde34-46f2-4477-90f2-00e8e73c0a36" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-77acde34-46f2-4477-90f2-00e8e73c0a36" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] snapshot: d69e49a4-1c96-4a70-aed3-ffe7078b13de, volume: 77acde34-46f2-4477-90f2-00e8e73c0a36, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf417e-8097-4524-b4b1-32dd8f441c04]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:37 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de Jul 08 19:41:37 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Flow 'volume_create_manager' (83167894-daf4-4cd1-aa19-8eb83cadafb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d8f281-69bf-447b-a08a-d211550cc9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d8f281-69bf-447b-a08a-d211550cc9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-624131490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65c0aae-f24a-4082-b48f-8ec68bfef82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8a57aba7c74a10a3a178b1555bf196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:38Z,use_quota=True,user_id='d59c39826201452581b2bb614e141018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261809e-e4b3-4108-8bc5-3ddbf987e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261809e-e4b3-4108-8bc5-3ddbf987e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07321290-d294-415d-814f-6cf721f9400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07321290-d294-415d-814f-6cf721f9400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65c0aae-f24a-4082-b48f-8ec68bfef82a', 'volume_name': 'volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5677bacf-40df-4aee-b40d-10781050bf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5677bacf-40df-4aee-b40d-10781050bf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9d605b-ed67-40a4-8316-78a007887485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:38 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Volume e65c0aae-f24a-4082-b48f-8ec68bfef82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a', 'volume_size': 1} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:38 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de" returned: 0 in 1.139s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04869b8-b702-4663-bd7a-c0644ab940d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f77296-e6e7-4b3c-b18f-2b826f7e77a8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:38 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:38 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:39 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 1.092s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:39 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:41:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:39 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 Jul 08 19:41:39 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:47 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36" returned: 0 in 7.999s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[09543ecf-fda2-4800-a278-e931831daf42]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:47 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:47 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:48 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=52,cinder:INSERT=17,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:41:48 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=46,cinder:INSERT=27,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:41:48 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 1.092s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:48 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3, size 1024.00 MB, duration 8.00 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:41:48 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Converted 1024.00 MB image at 127.99 MB/s Jul 08 19:41:48 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 19:41:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:48 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 Jul 08 19:41:48 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:49 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36" returned: 0 in 0.762s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-77acde34-46f2-4477-90f2-00e8e73c0a36" released by "_copy_volume_from_snapshot" :: held 12.221s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Acquiring lock "cinder-quobyte-d69e49a4-1c96-4a70-aed3-ffe7078b13de" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-d69e49a4-1c96-4a70-aed3-ffe7078b13de" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Deleting offline snapshot d69e49a4-1c96-4a70-aed3-ffe7078b13de of volume d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] snapshot_file for this snap is: volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[864834c6-abe0-4bab-ad05-0c5df33b3de7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:49 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de Jul 08 19:41:49 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:50 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04869b8-b702-4663-bd7a-c0644ab940d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:41:50 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5485436e-d954-44cc-b0e3-069c6debcba0]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:50 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:50 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:51 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 0.881s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:51 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de Jul 08 19:41:51 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:52 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de" returned: 0 in 0.811s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:52 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de Jul 08 19:41:52 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:53 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3.d69e49a4-1c96-4a70-aed3-ffe7078b13de" returned: 0 in 0.691s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-d69e49a4-1c96-4a70-aed3-ffe7078b13de" released by "_delete_snapshot" :: held 3.388s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.721s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.906s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-624131490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65c0aae-f24a-4082-b48f-8ec68bfef82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e8a57aba7c74a10a3a178b1555bf196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:41:38Z,use_quota=True,user_id='d59c39826201452581b2bb614e141018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Creating volume e65c0aae-f24a-4082-b48f-8ec68bfef82a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:41:53 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:41:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:53 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a 1073741824 Jul 08 19:41:53 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-021abd0e-582a-4b09-84c0-c624e9208d07 tempest-GroupsV314Test-483183364 None] Create group from source-group-10ef7e2f-7694-4dec-a9c4-27a47ced7a19 completed successfully. Jul 08 19:41:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Acquiring lock "cinder-quobyte-77acde34-46f2-4477-90f2-00e8e73c0a36" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-77acde34-46f2-4477-90f2-00e8e73c0a36" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[231e6906-e856-4566-9ee5-caa0e7566c48]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:54 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a 1073741824" returned: 0 in 1.153s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:54 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a Jul 08 19:41:54 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:54 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 Jul 08 19:41:54 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:55 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a" returned: 0 in 0.736s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:55 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9d605b-ed67-40a4-8316-78a007887485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16abb9c-05ca-4615-b0a2-5e610838a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36" returned: 0 in 0.875s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Volume volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a (e65c0aae-f24a-4082-b48f-8ec68bfef82a): created successfully Jul 08 19:41:55 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36 Jul 08 19:41:55 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16abb9c-05ca-4615-b0a2-5e610838a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Flow 'volume_create_manager' (83167894-daf4-4cd1-aa19-8eb83cadafb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:41:55 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-42c15187-4098-4447-bdaf-1925c3aeb10c tempest-AbsoluteLimitsTests-1331429617 None] Created volume successfully. Jul 08 19:41:55 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-77acde34-46f2-4477-90f2-00e8e73c0a36" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-77acde34-46f2-4477-90f2-00e8e73c0a36" released by "delete_volume" :: held 1.571s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Created reservations ['c7fe3cd3-c2d2-4673-bf10-78d35034a7be'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:55 devstack cinder-volume[87172]: WARNING cinder.quota [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-192290272 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-192290272, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:41:55 devstack cinder-volume[87172]: WARNING cinder.quota [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-192290272 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-192290272, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Created reservations ['1c2f39ba-34cf-4160-b622-41d64251d749', '48492b71-90c5-4a7e-b253-c7c5720549e4', '4b363fba-9cd0-43fa-a479-dbed4a9865ba', '3bca2ed9-8551-44b5-8962-93bd40a4e22c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Acquiring lock "cinder-e65c0aae-f24a-4082-b48f-8ec68bfef82a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Lock "cinder-e65c0aae-f24a-4082-b48f-8ec68bfef82a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:56 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:56 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Acquiring lock "cinder-quobyte-e65c0aae-f24a-4082-b48f-8ec68bfef82a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Lock "cinder-quobyte-e65c0aae-f24a-4082-b48f-8ec68bfef82a" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eafa49f-5de1-4837-aa4d-d44a66364a24]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:56 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a Jul 08 19:41:56 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:56 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:56 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0eb7b8b2-be63-4e73-9b59-3b276ac462b9 tempest-GroupsV314Test-483183364 None] Delete group completed successfully. Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Acquiring lock "cinder-quobyte-d04869b8-b702-4663-bd7a-c0644ab940d3" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-d04869b8-b702-4663-bd7a-c0644ab940d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a2836c-346d-4bab-b537-08c5b509798e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:41:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:57 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a" returned: 0 in 0.877s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:57 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a Jul 08 19:41:57 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:57 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:57 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:57 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e65c0aae-f24a-4082-b48f-8ec68bfef82a" returned: 0 in 0.672s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Lock "cinder-quobyte-e65c0aae-f24a-4082-b48f-8ec68bfef82a" released by "delete_volume" :: held 1.591s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Created reservations ['734b8258-d6e7-4501-94f1-3547deb1e48a', '135466de-cb54-42b8-b30a-560047585aa8', 'bf4d3a28-ceb6-4482-a429-2bb23ebdfc27', 'c5703340-4717-4f77-9dcf-86c2d0fc7b93'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:57 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 0.847s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:57 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3 Jul 08 19:41:57 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:57 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:57 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:58 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d04869b8-b702-4663-bd7a-c0644ab940d3" returned: 0 in 0.692s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Lock "cinder-quobyte-d04869b8-b702-4663-bd7a-c0644ab940d3" released by "delete_volume" :: held 1.609s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:58 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.729s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Deleted volume successfully. Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-adc3b4f1-cc16-4b18-9eae-8498b76a4281 tempest-AbsoluteLimitsTests-1331429617 None] Lock "cinder-e65c0aae-f24a-4082-b48f-8ec68bfef82a-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Created reservations ['a7b5f0ff-948a-4bb2-9594-f6b7acf0f978'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Created reservations ['d2cf2076-11d9-426d-b5b3-e1727dd10806', 'a73656d3-4da2-419d-a05c-9d69c855e97e', 'da3617d7-b723-4bba-b3ff-c8b6b4edd95d', 'b774ba01-b199-4d5e-8130-cee28c3a7d99'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:41:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:41:58 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:41:58 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:41:59 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 08 19:41:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:41:59 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:41:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a02f8c20-c54a-404c-ab5a-c220fcbe83df tempest-GroupsV314Test-483183364 None] Delete group completed successfully. Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Flow 'volume_create_manager' (5f2ab3b9-ce63-4a23-80d7-91d015edf3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97fe479-823a-4148-9b7a-81e6edb6c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97fe479-823a-4148-9b7a-81e6edb6c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-813228644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1546c59-8134-48a1-b300-acf23d9edb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0811ef7e1615421385997c0a5231df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:00Z,use_quota=True,user_id='2add2b4fd64d42a1820b947ef741e5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520ef235-58ca-4c06-b62c-a26dd7d55097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520ef235-58ca-4c06-b62c-a26dd7d55097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc01a75-8a2f-4a1b-8de4-f998eee82dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc01a75-8a2f-4a1b-8de4-f998eee82dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1546c59-8134-48a1-b300-acf23d9edb53', 'volume_name': 'volume-e1546c59-8134-48a1-b300-acf23d9edb53', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076b777c-41cd-4d9f-acf5-b47b19fc1f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076b777c-41cd-4d9f-acf5-b47b19fc1f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d639d336-6e69-4e2e-9cd8-efd255407a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Volume e1546c59-8134-48a1-b300-acf23d9edb53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1546c59-8134-48a1-b300-acf23d9edb53', 'volume_size': 1} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-813228644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1546c59-8134-48a1-b300-acf23d9edb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0811ef7e1615421385997c0a5231df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:00Z,use_quota=True,user_id='2add2b4fd64d42a1820b947ef741e5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Creating volume e1546c59-8134-48a1-b300-acf23d9edb53 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:00 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:00 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 1073741824 Jul 08 19:42:00 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:01 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 1073741824" returned: 0 in 1.018s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:01 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 Jul 08 19:42:01 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:02 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53" returned: 0 in 0.860s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d639d336-6e69-4e2e-9cd8-efd255407a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1546c59-8134-48a1-b300-acf23d9edb53', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe196629-ba61-452f-baa0-3316d00a1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:02 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Volume volume-e1546c59-8134-48a1-b300-acf23d9edb53 (e1546c59-8134-48a1-b300-acf23d9edb53): created successfully Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe196629-ba61-452f-baa0-3316d00a1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Flow 'volume_create_manager' (5f2ab3b9-ce63-4a23-80d7-91d015edf3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7b96107c-8b75-4ac6-9538-903ceee5015e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Created volume successfully. Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Flow 'volume_create_manager' (5dcd6147-ed5d-4146-921b-b7ee0401dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b6d56c-d2cc-4897-947c-5c18b823dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b6d56c-d2cc-4897-947c-5c18b823dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-571422701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34c4a13-101a-49a2-9fbc-85ec3b99753c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a41686161041c3b0b042afbca3ad4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:03Z,use_quota=True,user_id='1c8bd8226a154da5b765fe1f7ee63ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f301555-8308-4e69-912b-2663fa6f58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f301555-8308-4e69-912b-2663fa6f58f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9baa2f66-6fb3-47dd-9031-5a0955b9ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9baa2f66-6fb3-47dd-9031-5a0955b9ba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e34c4a13-101a-49a2-9fbc-85ec3b99753c', 'volume_name': 'volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e757867-d03b-4642-bb8d-5cafd919a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e757867-d03b-4642-bb8d-5cafd919a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0937220-354b-451f-b035-a150849cca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:03 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Volume e34c4a13-101a-49a2-9fbc-85ec3b99753c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c', 'volume_size': 1} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-571422701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34c4a13-101a-49a2-9fbc-85ec3b99753c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a41686161041c3b0b042afbca3ad4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:03Z,use_quota=True,user_id='1c8bd8226a154da5b765fe1f7ee63ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Creating volume e34c4a13-101a-49a2-9fbc-85ec3b99753c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:03 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "cinder-e1546c59-8134-48a1-b300-acf23d9edb53-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "cinder-e1546c59-8134-48a1-b300-acf23d9edb53-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:03 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c 1073741824 Jul 08 19:42:03 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "cinder-quobyte-e1546c59-8134-48a1-b300-acf23d9edb53" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "cinder-quobyte-e1546c59-8134-48a1-b300-acf23d9edb53" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc27ad9-6ba3-4179-b6b0-52a09ad9ba92]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:03 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 Jul 08 19:42:03 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:04 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53" returned: 0 in 0.922s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:04 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53 Jul 08 19:42:04 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:04 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c 1073741824" returned: 0 in 1.141s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:04 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c Jul 08 19:42:04 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:05 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e1546c59-8134-48a1-b300-acf23d9edb53" returned: 0 in 0.716s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "cinder-quobyte-e1546c59-8134-48a1-b300-acf23d9edb53" released by "delete_volume" :: held 1.693s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Created reservations ['48d865f2-04da-41a5-8d3d-46dc2f0d127b', '1b75c48d-e3f7-4700-9587-5e636fc41496', '6dbe3c39-8b05-4f04-8585-96e7d3d9aaa1', '87983242-b6a5-440f-86ab-cfb4d1bcdcf3'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:05 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c" returned: 0 in 0.694s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0937220-354b-451f-b035-a150849cca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c791a9-769a-48d7-9398-cfe5a3ec87d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Volume volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c (e34c4a13-101a-49a2-9fbc-85ec3b99753c): created successfully Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c791a9-769a-48d7-9398-cfe5a3ec87d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Flow 'volume_create_manager' (5dcd6147-ed5d-4146-921b-b7ee0401dc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6ddf0e46-9373-4a3f-82df-26e0195ae430 tempest-VolumesMetadataTest-2109774281 None] Created volume successfully. Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:05 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:05 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:06 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.729s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Deleted volume successfully. Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2c963b68-3916-4cde-8631-d9d42bf4cb7e tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "cinder-e1546c59-8134-48a1-b300-acf23d9edb53-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Flow 'volume_create_manager' (216c220f-610b-4d93-a55f-788016411730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6662218f-7fb3-4369-a5de-6dcc3f138e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6662218f-7fb3-4369-a5de-6dcc3f138e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1297843408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed559dc8-2d27-4ea8-b9ca-b890b4a186dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0811ef7e1615421385997c0a5231df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:06Z,use_quota=True,user_id='2add2b4fd64d42a1820b947ef741e5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112db344-25c5-4500-832c-de582d2b1415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112db344-25c5-4500-832c-de582d2b1415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0b73aa-5fca-420c-9ed8-dc6fc34d3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0b73aa-5fca-420c-9ed8-dc6fc34d3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed559dc8-2d27-4ea8-b9ca-b890b4a186dc', 'volume_name': 'volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a12db24-7f68-4d3d-b5d2-c5a55ac54922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a12db24-7f68-4d3d-b5d2-c5a55ac54922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df980c7-83fe-41f0-99c0-e0815b209bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:06 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Volume ed559dc8-2d27-4ea8-b9ca-b890b4a186dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc', 'volume_size': 1} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1297843408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed559dc8-2d27-4ea8-b9ca-b890b4a186dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0811ef7e1615421385997c0a5231df41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:06Z,use_quota=True,user_id='2add2b4fd64d42a1820b947ef741e5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Creating volume ed559dc8-2d27-4ea8-b9ca-b890b4a186dc {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:06 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:06 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc 1073741824 Jul 08 19:42:06 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Acquiring lock "cinder-e34c4a13-101a-49a2-9fbc-85ec3b99753c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Lock "cinder-e34c4a13-101a-49a2-9fbc-85ec3b99753c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Acquiring lock "cinder-quobyte-e34c4a13-101a-49a2-9fbc-85ec3b99753c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Lock "cinder-quobyte-e34c4a13-101a-49a2-9fbc-85ec3b99753c" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc805bb9-f4e2-46f7-a202-ce03c96d25de]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:07 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc 1073741824" returned: 0 in 1.055s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:07 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c Jul 08 19:42:07 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:07 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc Jul 08 19:42:07 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:08 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c" returned: 0 in 0.870s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:08 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc" returned: 0 in 0.756s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:08 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c Jul 08 19:42:08 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df980c7-83fe-41f0-99c0-e0815b209bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1293a7-e2f0-4beb-a36f-0ddb5d7b778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:08 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Volume volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc (ed559dc8-2d27-4ea8-b9ca-b890b4a186dc): created successfully Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1293a7-e2f0-4beb-a36f-0ddb5d7b778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Flow 'volume_create_manager' (216c220f-610b-4d93-a55f-788016411730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-16e4d217-0707-443d-86e6-ef7a6ed89ff3 tempest-VolumeQuotasAdminTestJSON-1015376104 None] Created volume successfully. Jul 08 19:42:09 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e34c4a13-101a-49a2-9fbc-85ec3b99753c" returned: 0 in 0.803s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Lock "cinder-quobyte-e34c4a13-101a-49a2-9fbc-85ec3b99753c" released by "delete_volume" :: held 1.734s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Created reservations ['fd1d7e06-b8b4-4f2a-9c23-b087ee94a7a5', '483482db-3019-4def-a9a8-72c7caa55329', '42c1367f-9c33-4618-a863-808d90c2d668', '0ae2ba8e-7e1b-465c-a342-e3a655863c28'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:09 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:09 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:10 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.983s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:10 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Deleted volume successfully. Jul 08 19:42:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1560f692-b068-47a2-9f26-6a1a0fd3e370 tempest-VolumesMetadataTest-2109774281 None] Lock "cinder-e34c4a13-101a-49a2-9fbc-85ec3b99753c-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-c01db605-bc4f-4c8d-acd7-2185070e50e5 req-af245a85-94ed-4e36-9e13-541fdb965aa3 tempest-TestShelveInstance-2082987520 None] Terminate volume connection completed successfully. Jul 08 19:42:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-c01db605-bc4f-4c8d-acd7-2185070e50e5 req-af245a85-94ed-4e36-9e13-541fdb965aa3 tempest-TestShelveInstance-2082987520 None] Deleting attachment 8ce20a94-f175-4f57-a7d2-09ad4c215bfa. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:42:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a05ce6c4-d3f5-4a71-805f-f65d36d518a1 tempest-VolumeQuotasAdminTestJSON-45499724 None] Transfer volume completed successfully. Jul 08 19:42:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Acquiring lock "cinder-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Lock "cinder-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Acquiring lock "cinder-quobyte-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Lock "cinder-quobyte-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f24842-43d7-40af-b6b9-6f1aac078983]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:12 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc Jul 08 19:42:12 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:12 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Flow 'volume_create_manager' (1038d914-bf3a-4a39-9bee-65b010fbc7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8027374f-7722-4906-a9b5-18987bf2e3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8027374f-7722-4906-a9b5-18987bf2e3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-70186049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08e35b7-98d8-4af7-9951-28895f4ab4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2173099aa334e299eaea5e07bc990ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:13Z,use_quota=True,user_id='2ba366f8e043442eb1b855d08e9bac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9ad5ee-0d7f-4a61-ae4e-d29095062235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9ad5ee-0d7f-4a61-ae4e-d29095062235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6cb6f9-d979-4c91-812b-60093b67c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6cb6f9-d979-4c91-812b-60093b67c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08e35b7-98d8-4af7-9951-28895f4ab4f7', 'volume_name': 'volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f88246e-fe33-4df1-8e7e-bac918c5ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f88246e-fe33-4df1-8e7e-bac918c5ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad88c4-d635-406b-ac36-e7e11c1971b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:13 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Volume b08e35b7-98d8-4af7-9951-28895f4ab4f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7', 'volume_size': 1} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-70186049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08e35b7-98d8-4af7-9951-28895f4ab4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2173099aa334e299eaea5e07bc990ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:13Z,use_quota=True,user_id='2ba366f8e043442eb1b855d08e9bac7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Creating volume b08e35b7-98d8-4af7-9951-28895f4ab4f7 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:13 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:13 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 1073741824 Jul 08 19:42:13 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:13 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc" returned: 0 in 1.091s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:13 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc Jul 08 19:42:13 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:14 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc" returned: 0 in 0.828s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Lock "cinder-quobyte-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc" released by "delete_volume" :: held 1.979s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Created reservations ['b8692c0a-4eb5-4882-9006-6474760998e8', 'd7a7e4e5-255c-4c00-828a-13cc5a795389', '02aadd46-ddb3-4145-be25-b03348cbc2c0', '0284c1d0-f54c-41a7-937b-20962890f7c7'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:14 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 1073741824" returned: 0 in 1.165s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:14 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:14 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:14 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 Jul 08 19:42:14 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:15 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:15 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.917s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Deleted volume successfully. Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad88c4-d635-406b-ac36-e7e11c1971b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d64d57d-5681-41a3-a89d-e66895ae3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Volume volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 (b08e35b7-98d8-4af7-9951-28895f4ab4f7): created successfully Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d64d57d-5681-41a3-a89d-e66895ae3b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Flow 'volume_create_manager' (1038d914-bf3a-4a39-9bee-65b010fbc7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-def624a8-3570-46e3-b85e-a5632e83900b tempest-VolumeQuotasAdminTestJSON-1633859698 None] Lock "cinder-ed559dc8-2d27-4ea8-b9ca-b890b4a186dc-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6be01d96-be6f-4b29-bbfc-f007f79b03b7 tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Created volume successfully. Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Flow 'volume_create_manager' (163ced0b-52cc-4ede-a2d5-28ed579307aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8d1c82-22ee-44f7-8776-77998361578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8d1c82-22ee-44f7-8776-77998361578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-167290221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b440e0-99b0-4673-8aa1-c2d412740eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3726d4d71bbd4617ad861e4b2a53cb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:17Z,use_quota=True,user_id='5a0b052e872d4fe48f5e5c800f76e013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121a0251-4be5-4ffe-b53c-8a8a1f1cb600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121a0251-4be5-4ffe-b53c-8a8a1f1cb600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a381732-1839-41ac-97b1-9d5dc60c56cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a381732-1839-41ac-97b1-9d5dc60c56cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b440e0-99b0-4673-8aa1-c2d412740eac', 'volume_name': 'volume-b9b440e0-99b0-4673-8aa1-c2d412740eac', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcb3bb7-12f1-4d89-9f5c-b9ffa813d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcb3bb7-12f1-4d89-9f5c-b9ffa813d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e89be5d-5a3a-4e57-ab57-f6f7b647b6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:16 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Volume b9b440e0-99b0-4673-8aa1-c2d412740eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b440e0-99b0-4673-8aa1-c2d412740eac', 'volume_size': 1} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-167290221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b440e0-99b0-4673-8aa1-c2d412740eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3726d4d71bbd4617ad861e4b2a53cb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:17Z,use_quota=True,user_id='5a0b052e872d4fe48f5e5c800f76e013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Creating volume b9b440e0-99b0-4673-8aa1-c2d412740eac {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:16 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:16 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac 1073741824 Jul 08 19:42:16 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Acquiring lock "cinder-b08e35b7-98d8-4af7-9951-28895f4ab4f7-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "cinder-b08e35b7-98d8-4af7-9951-28895f4ab4f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Acquiring lock "cinder-quobyte-b08e35b7-98d8-4af7-9951-28895f4ab4f7" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "cinder-quobyte-b08e35b7-98d8-4af7-9951-28895f4ab4f7" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f76223-5c04-45a0-91af-bec64e0c0f46]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:17 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 Jul 08 19:42:17 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:17 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac 1073741824" returned: 0 in 1.231s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:18 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac Jul 08 19:42:18 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:18 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7" returned: 0 in 1.035s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:18 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7 Jul 08 19:42:18 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:18 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac" returned: 0 in 0.730s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.875s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e89be5d-5a3a-4e57-ab57-f6f7b647b6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b440e0-99b0-4673-8aa1-c2d412740eac', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb83f581-3ae0-47cd-ae8b-8970d2f536fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:18 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Volume volume-b9b440e0-99b0-4673-8aa1-c2d412740eac (b9b440e0-99b0-4673-8aa1-c2d412740eac): created successfully Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb83f581-3ae0-47cd-ae8b-8970d2f536fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Flow 'volume_create_manager' (163ced0b-52cc-4ede-a2d5-28ed579307aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f9f38-26d8-49cb-ba5a-4d6e9d608e6e]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-91219174-0e8f-42c8-b5f9-ab93b415bffc tempest-VolumesTransfersV357Test-1729844870 None] Created volume successfully. Jul 08 19:42:18 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:42:18 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:19 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b08e35b7-98d8-4af7-9951-28895f4ab4f7" returned: 0 in 0.773s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "cinder-quobyte-b08e35b7-98d8-4af7-9951-28895f4ab4f7" released by "delete_volume" :: held 1.876s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Created reservations ['bb5e92b5-f7e9-45c4-bb82-5f4e066456fb', 'b4ec63d9-5b6a-41c6-a8b2-2fd5ecf8d1bf', '7f1bc600-4d82-44e9-8941-fb2aab32ec1b', 'ae709a80-6a10-45b5-89f7-0ae45c197abc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:19 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:19 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:19 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 0.936s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:19 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:42:19 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:20 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.884s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Deleted volume successfully. Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7d756edd-a400-4fa2-b961-77e6d58151ae tempest-VolumeQuotasNegativeTestJSON-2007152314 None] Lock "cinder-b08e35b7-98d8-4af7-9951-28895f4ab4f7-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:20 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 1 in 0.953s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.976s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-23837041-5108-4ba4-a30c-320d9e37b050', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c0ad397-1c65-4770-8b4d-e03d22362077', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:42:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-6a889659-5338-4253-b3b0-daaf4863d2bc req-77bda8b8-14a6-457c-b5c3-546055a2b71a tempest-TestShelveInstance-2082987520 None] attachment_update completed successfully. Jul 08 19:42:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9c179cfe-d4c6-4621-9b3a-e5af0525d758 tempest-VolumesTransfersV357Test-1178906416 None] Transfer volume completed successfully. Jul 08 19:42:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Acquiring lock "cinder-b9b440e0-99b0-4673-8aa1-c2d412740eac-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-b9b440e0-99b0-4673-8aa1-c2d412740eac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Acquiring lock "cinder-quobyte-b9b440e0-99b0-4673-8aa1-c2d412740eac" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-quobyte-b9b440e0-99b0-4673-8aa1-c2d412740eac" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d345007-37a7-4f04-a8e2-3cecf40d26cf]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:22 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac Jul 08 19:42:22 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:23 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac" returned: 0 in 0.860s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:23 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac Jul 08 19:42:23 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Flow 'volume_create_manager' (86f0cf6b-9256-42fe-a3eb-97890f71969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e463efa3-73f7-413c-ad7e-de10945d1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e463efa3-73f7-413c-ad7e-de10945d1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2095980441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358cc39e-c0aa-480b-a6e1-2ebec497a8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06eca797e87a440c9fbbcbee9fd60d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:24Z,use_quota=True,user_id='cc28dbeaf8e14f5b8bf2830714574878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7214fa63-cc35-4dae-9adc-f40927c34ca6),volume_type_id=7214fa63-cc35-4dae-9adc-f40927c34ca6)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bd5ebc-3a2a-48b7-bb23-433ca08f9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bd5ebc-3a2a-48b7-bb23-433ca08f9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2aa18e0-a498-42dc-8549-bffd229ca0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2aa18e0-a498-42dc-8549-bffd229ca0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358cc39e-c0aa-480b-a6e1-2ebec497a8c7', 'volume_name': 'volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d17b3d9-82e7-457a-95e1-6129ef756779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d17b3d9-82e7-457a-95e1-6129ef756779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10dad5e-e018-4e9a-969f-535cb9864b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:23 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Volume 358cc39e-c0aa-480b-a6e1-2ebec497a8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7', 'volume_size': 1} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2095980441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358cc39e-c0aa-480b-a6e1-2ebec497a8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06eca797e87a440c9fbbcbee9fd60d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:24Z,use_quota=True,user_id='cc28dbeaf8e14f5b8bf2830714574878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7214fa63-cc35-4dae-9adc-f40927c34ca6),volume_type_id=7214fa63-cc35-4dae-9adc-f40927c34ca6)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Creating volume 358cc39e-c0aa-480b-a6e1-2ebec497a8c7 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:23 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:23 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 1073741824 Jul 08 19:42:23 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:24 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9b440e0-99b0-4673-8aa1-c2d412740eac" returned: 0 in 0.761s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-quobyte-b9b440e0-99b0-4673-8aa1-c2d412740eac" released by "delete_volume" :: held 1.679s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Created reservations ['f4f5f7bb-1360-4b0b-a689-fd5a0f40b287', 'd779dbed-808b-4b47-a5cf-8933b03c796b', '8841fb7c-75b3-4c0a-9f8d-d47ecd81451f', 'a6114c57-803b-4bbe-a43d-4f2a202df8e3'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:24 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:24 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:24 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 1073741824" returned: 0 in 1.019s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:24 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 Jul 08 19:42:24 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:25 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.033s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Deleted volume successfully. Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7b48fcf1-1735-4530-b96b-e29537cdb794 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-b9b440e0-99b0-4673-8aa1-c2d412740eac-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Flow 'volume_create_manager' (75f04c88-9d9b-435d-bd24-88baa08e84ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f497c9b-adca-491f-a20b-610d4aa57d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f497c9b-adca-491f-a20b-610d4aa57d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-350652437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75cb028-6854-449c-8f88-fccc7ecbdc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3726d4d71bbd4617ad861e4b2a53cb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:25Z,use_quota=True,user_id='5a0b052e872d4fe48f5e5c800f76e013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1a7dc0-be84-4878-89bf-7e6c4a3fc57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1a7dc0-be84-4878-89bf-7e6c4a3fc57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d261992-a820-4c82-aae4-e8e96f2f2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d261992-a820-4c82-aae4-e8e96f2f2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75cb028-6854-449c-8f88-fccc7ecbdc0a', 'volume_name': 'volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fccdace-4176-47a2-841e-b5574045d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fccdace-4176-47a2-841e-b5574045d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa378f4-a595-4497-8a3a-1f73d94503c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:25 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Volume a75cb028-6854-449c-8f88-fccc7ecbdc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a', 'volume_size': 1} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:25 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-350652437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75cb028-6854-449c-8f88-fccc7ecbdc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3726d4d71bbd4617ad861e4b2a53cb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:25Z,use_quota=True,user_id='5a0b052e872d4fe48f5e5c800f76e013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Creating volume a75cb028-6854-449c-8f88-fccc7ecbdc0a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:25 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10dad5e-e018-4e9a-969f-535cb9864b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:25 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a 1073741824 Jul 08 19:42:25 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b99f17-3301-46f5-a700-9abfaba32fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:25 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Volume volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 (358cc39e-c0aa-480b-a6e1-2ebec497a8c7): created successfully Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b99f17-3301-46f5-a700-9abfaba32fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Flow 'volume_create_manager' (86f0cf6b-9256-42fe-a3eb-97890f71969c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1ba4c690-318f-4244-bceb-412d1412e0ca tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Created volume successfully. Jul 08 19:42:26 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a 1073741824" returned: 0 in 1.034s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Flow 'volume_create_manager' (517b2995-9a88-4b73-b406-247e97840e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9abbff2-b26d-4ccc-832b-fa311dfb3e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9abbff2-b26d-4ccc-832b-fa311dfb3e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-372562366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0277d75a-778f-44b5-87ae-75352f22a86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b212857ada444068755a656771ebdc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:27Z,use_quota=True,user_id='bacb3948fb244e259bedbb36e80ad2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06274c1e-3e9e-47a3-af95-dabd648d0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06274c1e-3e9e-47a3-af95-dabd648d0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd6e017-24ba-491f-a0ce-d0b3b1e8aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd6e017-24ba-491f-a0ce-d0b3b1e8aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0277d75a-778f-44b5-87ae-75352f22a86a', 'volume_name': 'volume-0277d75a-778f-44b5-87ae-75352f22a86a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8c7de9-62d4-4a70-aad8-fcc97d441654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8c7de9-62d4-4a70-aad8-fcc97d441654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4382ec-ce54-408b-bf17-4f0b64ddfceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Volume 0277d75a-778f-44b5-87ae-75352f22a86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0277d75a-778f-44b5-87ae-75352f22a86a', 'volume_size': 1} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:26 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a Jul 08 19:42:26 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:27 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:27 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:27 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a" returned: 0 in 0.733s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-372562366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0277d75a-778f-44b5-87ae-75352f22a86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b212857ada444068755a656771ebdc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:27Z,use_quota=True,user_id='bacb3948fb244e259bedbb36e80ad2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Creating volume 0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:27 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa378f4-a595-4497-8a3a-1f73d94503c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:27 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a 1073741824 Jul 08 19:42:27 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edbd1bc-959c-40b4-ba74-694d7df148d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Volume volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a (a75cb028-6854-449c-8f88-fccc7ecbdc0a): created successfully Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edbd1bc-959c-40b4-ba74-694d7df148d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Flow 'volume_create_manager' (75f04c88-9d9b-435d-bd24-88baa08e84ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1faf3e95-3354-489b-b690-2abbf8a18e46 tempest-VolumesTransfersV357Test-1729844870 None] Created volume successfully. Jul 08 19:42:28 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.688s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:28 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-611e8ec7-e421-4d32-9b7e-7c49e927ef9b tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Retype volume completed successfully. Jul 08 19:42:28 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a 1073741824" returned: 0 in 0.933s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:28 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a Jul 08 19:42:28 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Acquiring lock "cinder-358cc39e-c0aa-480b-a6e1-2ebec497a8c7-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "cinder-358cc39e-c0aa-480b-a6e1-2ebec497a8c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Acquiring lock "cinder-quobyte-358cc39e-c0aa-480b-a6e1-2ebec497a8c7" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "cinder-quobyte-358cc39e-c0aa-480b-a6e1-2ebec497a8c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75095b0-052e-4527-9b0c-4b667dd6a92b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Acquiring lock "cinder-a75cb028-6854-449c-8f88-fccc7ecbdc0a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-a75cb028-6854-449c-8f88-fccc7ecbdc0a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Acquiring lock "cinder-quobyte-a75cb028-6854-449c-8f88-fccc7ecbdc0a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-quobyte-a75cb028-6854-449c-8f88-fccc7ecbdc0a" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:29 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 Jul 08 19:42:29 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e798845e-a207-4a04-92e1-e6bdb4b0b4ad]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:29 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a Jul 08 19:42:29 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:29 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a" returned: 0 in 0.823s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4382ec-ce54-408b-bf17-4f0b64ddfceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0277d75a-778f-44b5-87ae-75352f22a86a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65dfb86-dc1b-49b4-941a-67b7ba00233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:29 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Volume volume-0277d75a-778f-44b5-87ae-75352f22a86a (0277d75a-778f-44b5-87ae-75352f22a86a): created successfully Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65dfb86-dc1b-49b4-941a-67b7ba00233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Flow 'volume_create_manager' (517b2995-9a88-4b73-b406-247e97840e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bf0772ef-a8c6-473c-b223-25d69e6267da tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Created volume successfully. Jul 08 19:42:29 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7" returned: 0 in 0.902s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:29 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7 Jul 08 19:42:29 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a" returned: 0 in 0.875s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:29 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:29 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a Jul 08 19:42:29 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Creating offline snapshot f580dcfe-d5d3-4138-b6bf-279a3e990a35 of volume 0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f3a7e3-5564-4967-a56d-d48cf181aa49]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:30 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a Jul 08 19:42:30 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:30 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-358cc39e-c0aa-480b-a6e1-2ebec497a8c7" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "cinder-quobyte-358cc39e-c0aa-480b-a6e1-2ebec497a8c7" released by "delete_volume" :: held 1.770s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:30 devstack cinder-volume[87172]: WARNING cinder.quota [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:42:30 devstack cinder-volume[87172]: WARNING cinder.quota [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Created reservations ['8ca95d7c-98a8-4b9e-9d91-821e0f132f2b', '3bbb1a0b-7d14-44de-8c0c-ac8f475afa94', 'de66b7e3-1f34-44c6-aa4c-b600c0d5e01d', 'b21796a8-42e7-45d7-8ac7-b5ec689c9038'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:30 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a75cb028-6854-449c-8f88-fccc7ecbdc0a" returned: 0 in 0.939s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-quobyte-a75cb028-6854-449c-8f88-fccc7ecbdc0a" released by "delete_volume" :: held 1.878s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:30 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:30 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:30 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Created reservations ['506c920b-66ed-49c8-a711-61cc5fbf86ea', '863648b1-72e7-4150-821f-300523b5b3b2', '2617b42b-1582-4ab2-b924-8f71cdccfce0', '18ea624e-5bbb-4640-a773-ffab3b976846'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:31 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:31 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:31 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a" returned: 0 in 1.285s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:31 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 1G Jul 08 19:42:31 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:32 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.515s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:32 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Deleted volume successfully. Jul 08 19:42:32 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-727aeed0-9999-425c-86be-8424238e7450 tempest-VolumeRetypeWithoutMigrationTest-1152456937 None] Lock "cinder-358cc39e-c0aa-480b-a6e1-2ebec497a8c7-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.288s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:32 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Deleted volume successfully. Jul 08 19:42:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-110f299e-4256-4d67-99b4-4f53eed6e500 tempest-VolumesTransfersV357Test-1099907070 None] Lock "cinder-a75cb028-6854-449c-8f88-fccc7ecbdc0a-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:33 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 1G" returned: 0 in 1.389s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0277d75a-778f-44b5-87ae-75352f22a86a -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:33 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0277d75a-778f-44b5-87ae-75352f22a86a -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 Jul 08 19:42:33 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:34 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0277d75a-778f-44b5-87ae-75352f22a86a -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35" returned: 0 in 1.099s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:34 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 is being set with open permissions: ugo+rw Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:34 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 Jul 08 19:42:34 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:34 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:34 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:35 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35" returned: 0 in 1.118s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:35 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info Jul 08 19:42:35 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:35 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.064s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:42:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:42:36 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info" returned: 0 in 1.153s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:36 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info is being set with open permissions: ugo+rw Jul 08 19:42:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:36 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info Jul 08 19:42:36 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:37 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.info" returned: 0 in 1.106s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.345s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:37 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-12f30813-d45c-4356-a61b-b73d59bdd308 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Create snapshot completed successfully Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "cinder-f580dcfe-d5d3-4138-b6bf-279a3e990a35-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-f580dcfe-d5d3-4138-b6bf-279a3e990a35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "cinder-quobyte-0277d75a-778f-44b5-87ae-75352f22a86a" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-quobyte-0277d75a-778f-44b5-87ae-75352f22a86a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "cinder-quobyte-f580dcfe-d5d3-4138-b6bf-279a3e990a35" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-quobyte-f580dcfe-d5d3-4138-b6bf-279a3e990a35" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Deleting offline snapshot f580dcfe-d5d3-4138-b6bf-279a3e990a35 of volume 0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] snapshot_file for this snap is: volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[381c6b5c-a793-4856-9cc3-b37c95ffbe61]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:39 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 Jul 08 19:42:39 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:39 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35" returned: 0 in 1.096s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0277d75a-778f-44b5-87ae-75352f22a86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:42:40 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1daaa19-8f80-47c2-91d0-5b94a98e9c6c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:40 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a Jul 08 19:42:40 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:40 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a" returned: 0 in 1.001s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:41 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 Jul 08 19:42:41 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Flow 'volume_create_manager' (79b150f2-e702-4c88-93ee-c42962c5f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f1c5d8-bcb9-41b2-ad7c-c7e80f054621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f1c5d8-bcb9-41b2-ad7c-c7e80f054621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1193250600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26b9e39-097d-4e0d-8a88-9cc09e5638ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c54b29aedd4fa8a72bec3e18580a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:41Z,use_quota=True,user_id='3543931b294747df8811d1e822e81c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baf1043-8cce-4850-aa13-aefcc8abef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baf1043-8cce-4850-aa13-aefcc8abef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db3d73-100a-4c49-96c1-d51f7cf538f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db3d73-100a-4c49-96c1-d51f7cf538f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'volume_name': 'volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f26e50-966e-42c0-9440-11ed622f1628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f26e50-966e-42c0-9440-11ed622f1628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8db92d4-743c-49a8-9f1c-952a4f435f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Volume c26b9e39-097d-4e0d-8a88-9cc09e5638ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'volume_size': 1} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1193250600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26b9e39-097d-4e0d-8a88-9cc09e5638ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c54b29aedd4fa8a72bec3e18580a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:41Z,use_quota=True,user_id='3543931b294747df8811d1e822e81c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Creating volume c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:42:41 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:42:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:41 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad 1073741824 Jul 08 19:42:41 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:42 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35" returned: 0 in 1.133s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:42 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35 Jul 08 19:42:42 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:42 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad 1073741824" returned: 0 in 1.126s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:42 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:42:42 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:42 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a.f580dcfe-d5d3-4138-b6bf-279a3e990a35" returned: 0 in 0.825s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-quobyte-f580dcfe-d5d3-4138-b6bf-279a3e990a35" released by "_delete_snapshot" :: held 4.224s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-quobyte-0277d75a-778f-44b5-87ae-75352f22a86a" released by "delete_snapshot" :: held 4.256s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Created reservations ['e0da5ae4-d4e6-46ab-929b-29bde7404d6b', '6932b636-f9b4-4eef-a9df-a516857e7e2b', 'c93424d6-b18f-4527-b7b0-d422eba47394', '8ffa2dad-57e7-4942-91fc-43b05e05b4ab'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Delete snapshot completed successfully. Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bdb84288-3370-41dd-b5d1-ff7d5c9117f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-f580dcfe-d5d3-4138-b6bf-279a3e990a35-delete_snapshot" released by "delete_snapshot" :: held 4.554s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:43 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 0.976s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8db92d4-743c-49a8-9f1c-952a4f435f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729c8b48-48ca-4b68-837c-0111deee185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:43 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Volume volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad (c26b9e39-097d-4e0d-8a88-9cc09e5638ad): created successfully Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729c8b48-48ca-4b68-837c-0111deee185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Flow 'volume_create_manager' (79b150f2-e702-4c88-93ee-c42962c5f95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-43b56739-a473-478a-a0cf-9ffbd4d2be22 tempest-VolumesCloneTest-307805724 None] Created volume successfully. Jul 08 19:42:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "cinder-0277d75a-778f-44b5-87ae-75352f22a86a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-0277d75a-778f-44b5-87ae-75352f22a86a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "cinder-quobyte-0277d75a-778f-44b5-87ae-75352f22a86a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-quobyte-0277d75a-778f-44b5-87ae-75352f22a86a" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1201e755-1e0b-416c-aed7-e367249c49ed]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:44 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a Jul 08 19:42:44 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Flow 'volume_create_manager' (92546d0c-b005-4dab-bbe7-5eb7c7cb56fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d00015-226c-46a3-a1f9-99fd3d3472cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d00015-226c-46a3-a1f9-99fd3d3472cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1527900559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c60c7f-5aa5-40dc-bd63-58e2000c7a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c54b29aedd4fa8a72bec3e18580a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:42:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c26b9e39-097d-4e0d-8a88-9cc09e5638ad,status='creating',terminated_at=None,updated_at=2026-07-08T17:42:45Z,use_quota=True,user_id='3543931b294747df8811d1e822e81c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b51b929-552d-4a76-add0-6d683d17acfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b51b929-552d-4a76-add0-6d683d17acfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c23c5d-ffc0-4c44-84a8-57e421d8f1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c23c5d-ffc0-4c44-84a8-57e421d8f1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '52c60c7f-5aa5-40dc-bd63-58e2000c7a09', 'volume_name': 'volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09', 'volume_size': 2, 'source_volid': 'c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'source_volstatus': 'available'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f946b91-c038-4983-8186-987731a2486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f946b91-c038-4983-8186-987731a2486b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabc83f3-ec82-4f53-9bbd-fad6e8925c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:42:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Volume 52c60c7f-5aa5-40dc-bd63-58e2000c7a09: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09', 'volume_size': 2, 'source_volid': 'c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'source_volstatus': 'available'} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:45 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Cloning volume c26b9e39-097d-4e0d-8a88-9cc09e5638ad to volume 52c60c7f-5aa5-40dc-bd63-58e2000c7a09 Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Creating offline snapshot 45f4cabc-953a-4447-8d8b-5dcba965767a of volume c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:42:45 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a" returned: 0 in 1.167s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd78b51-c43b-4c4a-8201-105b3ebcbbc5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:45 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a Jul 08 19:42:45 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:45 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:42:45 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:46 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0277d75a-778f-44b5-87ae-75352f22a86a" returned: 0 in 0.841s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-quobyte-0277d75a-778f-44b5-87ae-75352f22a86a" released by "delete_volume" :: held 2.093s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Created reservations ['9133db17-09f7-4b8d-b61c-c93823ba116c', '77d4daa0-7951-4157-bc9f-01a87b3b01f1', '61e86fc2-deec-4ae7-96f3-89d32d3d805a', '01601f4c-89fd-481e-bda7-6673657957cf'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:46 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 1.098s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:46 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:42:46 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:46 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a 1G Jul 08 19:42:46 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:47 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.836s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:47 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:42:47 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Deleted volume successfully. Jul 08 19:42:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-248199cd-d8e8-45bc-9a51-f229e2be0b44 tempest-VolumeSnapshotQuotasNegativeTestJSON-1280015263 None] Lock "cinder-0277d75a-778f-44b5-87ae-75352f22a86a-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:42:47 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a 1G" returned: 0 in 1.089s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:47 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a Jul 08 19:42:47 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:48 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a" returned: 0 in 1.027s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:48 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a is being set with open permissions: ugo+rw Jul 08 19:42:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:48 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a Jul 08 19:42:48 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:49 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a" returned: 0 in 1.046s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:49 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=131,cinder:SELECT=102,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:42:49 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=150,cinder:SELECT=121,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:42:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:49 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info Jul 08 19:42:49 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:50 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info" returned: 0 in 0.859s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:50 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info is being set with open permissions: ugo+rw Jul 08 19:42:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:50 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info Jul 08 19:42:50 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:51 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.info" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Acquiring lock "cinder-quobyte-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] snapshot: 45f4cabc-953a-4447-8d8b-5dcba965767a, volume: 52c60c7f-5aa5-40dc-bd63-58e2000c7a09, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50745a-154f-4a2e-bc18-6ee12b2bad55]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:51 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a Jul 08 19:42:51 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:52 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a" returned: 0 in 0.858s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:42:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:42:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:42:52 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba564186-4e7f-4919-96a1-8aa188652cd3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:52 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:42:52 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:53 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:53 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:42:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:53 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 Jul 08 19:42:53 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:59 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 08 19:42:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" returned: 0 in 5.988s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:42:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c89baf9-0385-4d43-a916-98abaafd078b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:42:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:42:59 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:42:59 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:42:59 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:43:00 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 1.180s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:00 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:43:00 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Converted 1024.00 MB image at 170.97 MB/s Jul 08 19:43:00 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 is being set with open permissions: ugo+rw Jul 08 19:43:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:00 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 Jul 08 19:43:00 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:01 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" returned: 0 in 0.739s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" released by "_copy_volume_from_snapshot" :: held 9.703s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Acquiring lock "cinder-quobyte-45f4cabc-953a-4447-8d8b-5dcba965767a" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-45f4cabc-953a-4447-8d8b-5dcba965767a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Deleting offline snapshot 45f4cabc-953a-4447-8d8b-5dcba965767a of volume c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] snapshot_file for this snap is: volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8c2e1-42ae-44c5-a314-6f38bb5fcd0f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:01 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a Jul 08 19:43:01 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Flow 'volume_create_manager' (4ef24dff-ae77-43dc-98d0-17abb20f9fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c96ba13-dcc5-48ca-856a-25cc201447df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c96ba13-dcc5-48ca-856a-25cc201447df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1478981101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e7f7588a324285a4e1eb6b38e45ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:01Z,use_quota=True,user_id='9e5dd2434ac64921927c31a2f1356186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0368a5-2eee-455a-97a3-19248455073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0368a5-2eee-455a-97a3-19248455073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb931ccc-fc7d-4e23-ac0e-2de02af7fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb931ccc-fc7d-4e23-ac0e-2de02af7fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5', 'volume_name': 'volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140dfcc7-8ad7-4722-afaa-aa423038d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140dfcc7-8ad7-4722-afaa-aa423038d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3d4058-45f6-45f9-bf16-2956756bfe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:01 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Volume 109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5', 'volume_size': 1} Jul 08 19:43:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:02 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a" returned: 0 in 0.933s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:43:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[32375040-1748-430f-983d-b8e9f6f33f68]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:02 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:43:02 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:03 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 0.881s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:03 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a Jul 08 19:43:03 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:03 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a" returned: 0 in 0.754s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:03 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a Jul 08 19:43:03 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:04 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad.45f4cabc-953a-4447-8d8b-5dcba965767a" returned: 0 in 0.695s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-45f4cabc-953a-4447-8d8b-5dcba965767a" released by "_delete_snapshot" :: held 3.374s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.221s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1478981101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e7f7588a324285a4e1eb6b38e45ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:01Z,use_quota=True,user_id='9e5dd2434ac64921927c31a2f1356186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Creating volume 109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:04 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:04 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 1073741824 Jul 08 19:43:04 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabc83f3-ec82-4f53-9bbd-fad6e8925c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09', 'volume_size': 2, 'source_volid': 'c26b9e39-097d-4e0d-8a88-9cc09e5638ad', 'source_volstatus': 'available'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6032278c-ff8b-4127-b69b-10bc04eead3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:04 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Volume volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 (52c60c7f-5aa5-40dc-bd63-58e2000c7a09): created successfully Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6032278c-ff8b-4127-b69b-10bc04eead3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Flow 'volume_create_manager' (92546d0c-b005-4dab-bbe7-5eb7c7cb56fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-236ad596-d091-4c15-a20f-abc1421486aa tempest-VolumesCloneTest-307805724 None] Created volume successfully. Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Acquiring lock "cinder-52c60c7f-5aa5-40dc-bd63-58e2000c7a09-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Lock "cinder-52c60c7f-5aa5-40dc-bd63-58e2000c7a09-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Acquiring lock "cinder-quobyte-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a27a562-dd5b-43cf-85ba-1b09d4aa5958]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:05 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 Jul 08 19:43:05 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:05 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 1073741824" returned: 0 in 0.988s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:05 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 Jul 08 19:43:05 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:06 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" returned: 0 in 0.852s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:06 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09 Jul 08 19:43:06 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:06 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5" returned: 0 in 0.665s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3d4058-45f6-45f9-bf16-2956756bfe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f3b55f-b8fa-4c23-83e7-1f4243748e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:06 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Volume volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 (109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5): created successfully Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f3b55f-b8fa-4c23-83e7-1f4243748e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Flow 'volume_create_manager' (4ef24dff-ae77-43dc-98d0-17abb20f9fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a51a620e-7b41-4879-b6a6-0a92b087a2d4 tempest-VolumesTransfersV355Test-1067818212 None] Created volume successfully. Jul 08 19:43:06 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" returned: 0 in 0.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-52c60c7f-5aa5-40dc-bd63-58e2000c7a09" released by "delete_volume" :: held 1.598s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Created reservations ['f7dc1645-a623-48d7-ac23-45d19ad6b6da', '6ca6fe4a-98a0-46e7-afbc-b31820647c93', 'dba2ad0a-ddd1-41f6-a230-5586c7c49766', '6af011b2-5b66-43e3-8f7a-e949985261d6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:07 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:07 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-91b96b65-a781-444c-8bec-cf99b60ac549 tempest-VolumesTransfersV355Test-1789443755 None] Transfer volume completed successfully. Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Acquiring lock "cinder-c26b9e39-097d-4e0d-8a88-9cc09e5638ad-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Lock "cinder-c26b9e39-097d-4e0d-8a88-9cc09e5638ad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Acquiring lock "cinder-quobyte-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" acquired by "delete_volume" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[919c6b19-e654-4b00-9359-6ba141450093]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:07 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:43:07 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:07 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.766s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Deleted volume successfully. Jul 08 19:43:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5aeed2ad-beda-42ed-9706-727249824490 tempest-VolumesCloneTest-307805724 None] Lock "cinder-52c60c7f-5aa5-40dc-bd63-58e2000c7a09-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:08 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Acquiring lock "cinder-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 0.867s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:08 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad Jul 08 19:43:08 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Acquiring lock "cinder-quobyte-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-quobyte-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd298157-d773-4026-bb2f-7b14100f8d3c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Flow 'volume_create_manager' (7e8bf5f7-8a21-4fda-a901-592562eac4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f448b78-d63f-496a-a199-54288d839c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f448b78-d63f-496a-a199-54288d839c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1189342709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4370f76-9fae-4705-8221-a1aa6cc3ad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd370267d2848ed9619d6990af16979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:09Z,use_quota=True,user_id='10665da5a2b14675bca5c1abad9e1e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c81dfb-ee64-47ea-8afb-845890fbe3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c81dfb-ee64-47ea-8afb-845890fbe3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30248bdc-a8c8-4b79-9223-37b8db0e444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30248bdc-a8c8-4b79-9223-37b8db0e444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4370f76-9fae-4705-8221-a1aa6cc3ad93', 'volume_name': 'volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89da45d9-78f2-4ff2-afee-f266b05da7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89da45d9-78f2-4ff2-afee-f266b05da7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7bd097-2c29-455f-9ae5-c66b904a077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:08 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Volume f4370f76-9fae-4705-8221-a1aa6cc3ad93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93', 'volume_size': 1} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1189342709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4370f76-9fae-4705-8221-a1aa6cc3ad93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd370267d2848ed9619d6990af16979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:09Z,use_quota=True,user_id='10665da5a2b14675bca5c1abad9e1e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Creating volume f4370f76-9fae-4705-8221-a1aa6cc3ad93 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:08 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 Jul 08 19:43:08 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:08 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:08 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 1073741824 Jul 08 19:43:08 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:09 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" returned: 0 in 0.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Lock "cinder-quobyte-c26b9e39-097d-4e0d-8a88-9cc09e5638ad" released by "delete_volume" :: held 1.670s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Created reservations ['e638247d-96e9-4e60-a506-8b207f049658', '870c3d6f-a870-431f-ae72-3bfd4ec66bfa', 'f609be31-1f1f-4e36-b509-707b9446cf37', '8819d1f1-96f8-4aa0-9ed7-ce1934e1e60a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:09 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:09 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:09 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5" returned: 0 in 0.855s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:09 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5 Jul 08 19:43:09 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:09 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 1073741824" returned: 0 in 0.913s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:09 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 Jul 08 19:43:09 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:10 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.728s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Deleted volume successfully. Jul 08 19:43:10 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5" returned: 0 in 0.730s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-quobyte-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5" released by "delete_volume" :: held 1.645s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:10 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93" returned: 0 in 0.714s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-961be679-4260-4fa5-a852-14ad32387edb tempest-VolumesCloneTest-307805724 None] Lock "cinder-c26b9e39-097d-4e0d-8a88-9cc09e5638ad-delete_volume" released by "delete_volume" :: held 3.869s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:12 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Created reservations ['bcb9cdac-3cd3-4bf0-b393-d5b4cb6a91f9', '38f19927-9f5c-4689-a8ba-dfeabb36c0d3', 'fe2b6ce8-53ba-452c-b95b-238cb2f0bfcb', '8f751128-9143-411c-822d-9d35405b234d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7bd097-2c29-455f-9ae5-c66b904a077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afb4364-f06f-454a-9e32-ab73f95c982a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Volume volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 (f4370f76-9fae-4705-8221-a1aa6cc3ad93): created successfully Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afb4364-f06f-454a-9e32-ab73f95c982a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Flow 'volume_create_manager' (7e8bf5f7-8a21-4fda-a901-592562eac4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ff1d3d5f-025b-4c22-a4c2-3f4e040788bf tempest-VolumesTransfersTest-855231055 None] Created volume successfully. Jul 08 19:43:15 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:15 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:17 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Flow 'volume_create_manager' (f359e05e-cba5-42b9-a51a-2f4ec9c20ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c0fb2-cd33-42bb-aa89-194b2ffff607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.256s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Deleted volume successfully. Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9c0fb2-cd33-42bb-aa89-194b2ffff607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1502573763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351a9c2c-a2f5-4d66-af1d-b1174aea605f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e7f7588a324285a4e1eb6b38e45ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:17Z,use_quota=True,user_id='9e5dd2434ac64921927c31a2f1356186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae9fdf6-6820-465f-bb88-8929ba0ae9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae9fdf6-6820-465f-bb88-8929ba0ae9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95968d4-7180-4cdc-829c-9e4ffab58466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95968d4-7180-4cdc-829c-9e4ffab58466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351a9c2c-a2f5-4d66-af1d-b1174aea605f', 'volume_name': 'volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f921fcf0-220a-44b4-a52d-442a16326789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f921fcf0-220a-44b4-a52d-442a16326789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ceeb7f-cb48-443e-8a33-3b8d1a5f746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Volume 351a9c2c-a2f5-4d66-af1d-b1174aea605f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f', 'volume_size': 1} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1502573763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351a9c2c-a2f5-4d66-af1d-b1174aea605f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5e7f7588a324285a4e1eb6b38e45ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:17Z,use_quota=True,user_id='9e5dd2434ac64921927c31a2f1356186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Creating volume 351a9c2c-a2f5-4d66-af1d-b1174aea605f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:17 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:17 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f 1073741824 Jul 08 19:43:17 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ac9df2f4-1692-4762-9669-4e40ba10df1f tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-109f3f0c-a60f-4a38-b4a7-cf9b1fdd21b5-delete_volume" released by "delete_volume" :: held 8.642s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f089cb03-c739-4195-9e35-6bbe1682cf29 tempest-VolumesTransfersTest-483166374 None] Transfer volume completed successfully. Jul 08 19:43:18 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f 1073741824" returned: 0 in 1.045s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:18 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f Jul 08 19:43:18 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Acquiring lock "cinder-f4370f76-9fae-4705-8221-a1aa6cc3ad93-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-f4370f76-9fae-4705-8221-a1aa6cc3ad93-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Acquiring lock "cinder-quobyte-f4370f76-9fae-4705-8221-a1aa6cc3ad93" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-quobyte-f4370f76-9fae-4705-8221-a1aa6cc3ad93" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c49388-a38f-4d04-aba1-f09cb555cefb]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:19 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 Jul 08 19:43:19 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (741dd178-92a1-4934-be56-3630fa9c964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:19 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854beb22-4c19-43b3-977c-fc5c16a922e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f" returned: 0 in 1.011s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854beb22-4c19-43b3-977c-fc5c16a922e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-935659969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3e909b-b699-411a-9197-fbbe3f23849b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:19Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbb1d2a-2462-46ff-a9c7-bca9c32942b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbb1d2a-2462-46ff-a9c7-bca9c32942b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1beb0776-5211-4c40-95a6-17c706d94ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1beb0776-5211-4c40-95a6-17c706d94ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3e909b-b699-411a-9197-fbbe3f23849b', 'volume_name': 'volume-dd3e909b-b699-411a-9197-fbbe3f23849b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faea1b32-f9b2-4bfb-93a4-68eb0f87c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faea1b32-f9b2-4bfb-93a4-68eb0f87c699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da589480-bbba-471e-a482-98ac5454a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Volume dd3e909b-b699-411a-9197-fbbe3f23849b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3e909b-b699-411a-9197-fbbe3f23849b', 'volume_size': 1} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-935659969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3e909b-b699-411a-9197-fbbe3f23849b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:19Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Creating volume dd3e909b-b699-411a-9197-fbbe3f23849b {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:19 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ceeb7f-cb48-443e-8a33-3b8d1a5f746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefcc5cf-08eb-4a26-a669-c8a9b27001f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:19 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b 1073741824 Jul 08 19:43:19 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Volume volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f (351a9c2c-a2f5-4d66-af1d-b1174aea605f): created successfully Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefcc5cf-08eb-4a26-a669-c8a9b27001f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Flow 'volume_create_manager' (f359e05e-cba5-42b9-a51a-2f4ec9c20ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ce1474e9-eba3-4781-bc0f-2695a34b4456 tempest-VolumesTransfersV355Test-1067818212 None] Created volume successfully. Jul 08 19:43:19 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93" returned: 0 in 0.842s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:19 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93 Jul 08 19:43:19 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:20 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b 1073741824" returned: 0 in 0.972s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:20 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b Jul 08 19:43:20 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Acquiring lock "cinder-351a9c2c-a2f5-4d66-af1d-b1174aea605f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-351a9c2c-a2f5-4d66-af1d-b1174aea605f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Acquiring lock "cinder-quobyte-351a9c2c-a2f5-4d66-af1d-b1174aea605f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:20 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-quobyte-351a9c2c-a2f5-4d66-af1d-b1174aea605f" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f4370f76-9fae-4705-8221-a1aa6cc3ad93" returned: 0 in 0.697s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-quobyte-f4370f76-9fae-4705-8221-a1aa6cc3ad93" released by "delete_volume" :: held 1.593s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[372e43c5-4250-4a82-88c5-e1fb13e9a526]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Created reservations ['334d3e57-37c9-48ff-b019-82ae2e6d3cab', '45b17d6b-b871-414c-8594-dfdf32bf56a5', 'b15f2df9-f158-4496-859c-0f5a673f9cb1', '1519a900-963c-4ebd-a50a-a19c7ae9d432'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:20 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f Jul 08 19:43:20 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:20 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:20 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-bb0879e7-a7a3-4e93-af8d-4443d552b3b0 tempest-TestShelveInstance-2082987520 None] Terminate volume connection completed successfully. Jul 08 19:43:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-bb0879e7-a7a3-4e93-af8d-4443d552b3b0 tempest-TestShelveInstance-2082987520 None] Deleting attachment 9c0ad397-1c65-4770-8b4d-e03d22362077. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:43:21 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b" returned: 0 in 0.775s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da589480-bbba-471e-a482-98ac5454a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3e909b-b699-411a-9197-fbbe3f23849b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a84b73-b398-419b-97da-75268dbd8926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Volume volume-dd3e909b-b699-411a-9197-fbbe3f23849b (dd3e909b-b699-411a-9197-fbbe3f23849b): created successfully Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a84b73-b398-419b-97da-75268dbd8926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (741dd178-92a1-4934-be56-3630fa9c964d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-56412b80-d08a-4bb2-8f80-1a7dbf8f2c29 tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:43:21 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Acquiring lock "cinder-23837041-5108-4ba4-a30c-320d9e37b050-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f" returned: 0 in 0.946s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:21 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Lock "cinder-23837041-5108-4ba4-a30c-320d9e37b050-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.830s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:21 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f Jul 08 19:43:21 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Deleted volume successfully. Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5664ba9c-f834-41c1-b34c-22642a2a6fa9 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-f4370f76-9fae-4705-8221-a1aa6cc3ad93-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Acquiring lock "cinder-quobyte-23837041-5108-4ba4-a30c-320d9e37b050" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Lock "cinder-quobyte-23837041-5108-4ba4-a30c-320d9e37b050" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e0671-feaa-438a-81f4-c4fa6ba0e0c7]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Flow 'volume_create_manager' (32f8a584-d2d0-4260-8ceb-e2767935cf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a5ea2d-211a-4888-8118-14884c41aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a5ea2d-211a-4888-8118-14884c41aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-911399107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca5db22-69a1-443e-9699-3e4b60171d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd370267d2848ed9619d6990af16979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:22Z,use_quota=True,user_id='10665da5a2b14675bca5c1abad9e1e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2dca6d-5ab8-4568-a75e-ec1f44aea1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2dca6d-5ab8-4568-a75e-ec1f44aea1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91445e40-36a0-4d38-985d-a335a6480db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91445e40-36a0-4d38-985d-a335a6480db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca5db22-69a1-443e-9699-3e4b60171d40', 'volume_name': 'volume-7ca5db22-69a1-443e-9699-3e4b60171d40', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171cca9b-e786-4473-a1a0-0d059cc89019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171cca9b-e786-4473-a1a0-0d059cc89019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd7cfe2-0463-4b2a-b37b-d8c0d3e7cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Volume 7ca5db22-69a1-443e-9699-3e4b60171d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca5db22-69a1-443e-9699-3e4b60171d40', 'volume_size': 1} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-911399107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca5db22-69a1-443e-9699-3e4b60171d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd370267d2848ed9619d6990af16979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:22Z,use_quota=True,user_id='10665da5a2b14675bca5c1abad9e1e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Creating volume 7ca5db22-69a1-443e-9699-3e4b60171d40 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:21 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:21 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:43:21 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:22 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 1073741824 Jul 08 19:43:22 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:22 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-351a9c2c-a2f5-4d66-af1d-b1174aea605f" returned: 0 in 0.953s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-quobyte-351a9c2c-a2f5-4d66-af1d-b1174aea605f" released by "delete_volume" :: held 1.949s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Created reservations ['05946aab-1da0-4b7e-bde3-557d43815f35', 'fc5e3858-218e-4ef4-a172-1873b9a879ef', '0d6752d7-1263-4ce9-bef9-a2eb53647ee1', '2d58beec-f6b0-4eeb-a8c6-4b94e7d67dfd'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:22 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (e29adfd9-8c95-41e3-b9f0-2b20b1223081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eee14d6-f6fa-4b6f-a3b2-5d207eec8405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 0.952s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eee14d6-f6fa-4b6f-a3b2-5d207eec8405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1252004367',display_name='tempest-VolumesGetTest-Volume-1680114973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498369c0-86ac-4a88-a54b-53db67f8ce57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:23Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e619812f-03ed-4ac9-854f-98e4d8b47f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e619812f-03ed-4ac9-854f-98e4d8b47f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9314fb0-d9fa-48e9-9961-e7fe1fe7c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9314fb0-d9fa-48e9-9961-e7fe1fe7c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '498369c0-86ac-4a88-a54b-53db67f8ce57', 'volume_name': 'volume-498369c0-86ac-4a88-a54b-53db67f8ce57', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb7373a-9e93-4860-b612-4b9113fad123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb7373a-9e93-4860-b612-4b9113fad123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2317f0eb-de4e-40cd-956c-353e65a82d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Volume 498369c0-86ac-4a88-a54b-53db67f8ce57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-498369c0-86ac-4a88-a54b-53db67f8ce57', 'volume_size': 1} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:22 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:43:22 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:22 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:22 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:23 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 1073741824" returned: 0 in 1.142s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:23 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 Jul 08 19:43:23 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:23 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 1 in 0.924s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:23 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.857s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:23 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050 Jul 08 19:43:23 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Deleted volume successfully. Jul 08 19:43:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b1cb5fc3-0d9f-4bf6-a812-b3a276c3af55 tempest-VolumesTransfersV355Test-883419195 None] Lock "cinder-351a9c2c-a2f5-4d66-af1d-b1174aea605f-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:24 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40" returned: 0 in 0.841s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1252004367',display_name='tempest-VolumesGetTest-Volume-1680114973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498369c0-86ac-4a88-a54b-53db67f8ce57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:23Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Creating volume 498369c0-86ac-4a88-a54b-53db67f8ce57 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:24 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:24 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 1073741824 Jul 08 19:43:24 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd7cfe2-0463-4b2a-b37b-d8c0d3e7cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca5db22-69a1-443e-9699-3e4b60171d40', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f4949c-4efe-4e99-9481-a3ad0e345f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Volume volume-7ca5db22-69a1-443e-9699-3e4b60171d40 (7ca5db22-69a1-443e-9699-3e4b60171d40): created successfully Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f4949c-4efe-4e99-9481-a3ad0e345f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Flow 'volume_create_manager' (32f8a584-d2d0-4260-8ceb-e2767935cf64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cb4b68d8-2461-41bd-8a19-04cf977202fa tempest-VolumesTransfersTest-855231055 None] Created volume successfully. Jul 08 19:43:24 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-23837041-5108-4ba4-a30c-320d9e37b050" returned: 0 in 0.835s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Lock "cinder-quobyte-23837041-5108-4ba4-a30c-320d9e37b050" released by "delete_volume" :: held 2.796s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.quota [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Created reservations ['1b9821f6-eb96-4659-8456-1115af25f556', '8e9ac822-91f0-4ce9-9c5b-5e09496be375', '84255a81-ac12-450b-a2d4-a005b555f915', '9b6471b7-24cf-43c9-9302-5950a37cadf5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:24 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:24 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:25 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 1073741824" returned: 0 in 1.182s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:25 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 Jul 08 19:43:25 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Acquiring lock "cinder-7ca5db22-69a1-443e-9699-3e4b60171d40-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-7ca5db22-69a1-443e-9699-3e4b60171d40-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Acquiring lock "cinder-quobyte-7ca5db22-69a1-443e-9699-3e4b60171d40" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-quobyte-7ca5db22-69a1-443e-9699-3e4b60171d40" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6bc990-9f11-4bbf-8501-9b1ea9276e44]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:25 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.100s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG cinder.manager [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Deleted volume successfully. Jul 08 19:43:25 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 Jul 08 19:43:25 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [req-9c0dc766-379e-4984-b4c5-655ea078ebe4 req-983a3a4d-347e-41bb-aab3-f3d90ca708e4 tempest-TestShelveInstance-2082987520 None] Lock "cinder-23837041-5108-4ba4-a30c-320d9e37b050-delete_volume" released by "delete_volume" :: held 4.238s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:26 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57" returned: 0 in 0.832s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2317f0eb-de4e-40cd-956c-353e65a82d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498369c0-86ac-4a88-a54b-53db67f8ce57', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926c8cb1-e63e-4362-8aa1-7036963f2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Volume volume-498369c0-86ac-4a88-a54b-53db67f8ce57 (498369c0-86ac-4a88-a54b-53db67f8ce57): created successfully Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926c8cb1-e63e-4362-8aa1-7036963f2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (e29adfd9-8c95-41e3-b9f0-2b20b1223081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2309d916-c378-49cd-a6df-60820be53147 tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:43:26 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40" returned: 0 in 1.063s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:26 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40 Jul 08 19:43:26 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-498369c0-86ac-4a88-a54b-53db67f8ce57-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Lock "cinder-498369c0-86ac-4a88-a54b-53db67f8ce57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-498369c0-86ac-4a88-a54b-53db67f8ce57" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-498369c0-86ac-4a88-a54b-53db67f8ce57" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ed44f-90f2-4186-95fb-1e28c374fca8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:27 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 Jul 08 19:43:27 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:27 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ca5db22-69a1-443e-9699-3e4b60171d40" returned: 0 in 0.816s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-quobyte-7ca5db22-69a1-443e-9699-3e4b60171d40" released by "delete_volume" :: held 1.938s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Created reservations ['817cbd70-7f7f-410f-8903-dbf871808039', '6aa6f2bd-bedd-461d-98e8-398db311b0d1', '496ef3f6-82dc-42bc-80d7-92101b327e8d', 'db7e0218-48fd-45c3-a734-3e810711263c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:27 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:27 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:28 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57" returned: 0 in 1.211s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:28 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57 Jul 08 19:43:28 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:28 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.942s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:28 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:28 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Deleted volume successfully. Jul 08 19:43:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9d1b7dac-8a32-497c-bc82-77fc0d1ee664 tempest-VolumesTransfersTest-1909460074 None] Lock "cinder-7ca5db22-69a1-443e-9699-3e4b60171d40-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:29 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-498369c0-86ac-4a88-a54b-53db67f8ce57" returned: 0 in 0.924s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-498369c0-86ac-4a88-a54b-53db67f8ce57" released by "delete_volume" :: held 2.212s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Created reservations ['5def4ae9-b7a1-4658-b73e-17e673cb70d4', 'fe098298-d917-4dbf-868a-f5be264deb8d', 'a43217e7-7055-45ca-9e86-57c2d9eb539b', '58c7f05b-c708-4a96-b583-632328004f8a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:29 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:29 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:30 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.782s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cfaeef76-4ec2-412f-b6f9-90c62b6879b4 tempest-VolumesGetTest-19209065 None] Lock "cinder-498369c0-86ac-4a88-a54b-53db67f8ce57-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-dd3e909b-b699-411a-9197-fbbe3f23849b-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Lock "cinder-dd3e909b-b699-411a-9197-fbbe3f23849b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-dd3e909b-b699-411a-9197-fbbe3f23849b" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-dd3e909b-b699-411a-9197-fbbe3f23849b" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a6057-5b67-4ec4-8d74-1f85d6b4d48f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:31 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b Jul 08 19:43:31 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:31 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b" returned: 0 in 0.912s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:31 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b Jul 08 19:43:31 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:32 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd3e909b-b699-411a-9197-fbbe3f23849b" returned: 0 in 0.747s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-dd3e909b-b699-411a-9197-fbbe3f23849b" released by "delete_volume" :: held 1.719s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Created reservations ['84d86720-f9e7-4226-9bc3-fc27443c8117', 'a652453d-6e16-4041-913a-73402e0c68d9', '03535b42-3381-4a10-b047-29d0fb9d8f12', '24a502ff-f211-4787-bb41-b8946f3b8442'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:32 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:32 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:33 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.921s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:33 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (d38e52a5-a573-444c-a974-e057fb09f5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b3ed61-0f36-4f15-a837-9f7f580455a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b3ed61-0f36-4f15-a837-9f7f580455a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-629888044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e29edc6-30a1-44ef-8c27-a4fdc4db8a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:34Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df4318d-2703-492d-9356-16cca0bd21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df4318d-2703-492d-9356-16cca0bd21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c9873d-00d2-4984-98c5-3985cbb5d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c9873d-00d2-4984-98c5-3985cbb5d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'volume_name': 'volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e6f20d-da53-4f68-8429-b6d2c09899c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e6f20d-da53-4f68-8429-b6d2c09899c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260e29fd-2053-4107-9561-081ec340cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:33 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Volume 3e29edc6-30a1-44ef-8c27-a4fdc4db8a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'volume_size': 1} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-629888044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e29edc6-30a1-44ef-8c27-a4fdc4db8a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:34Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Creating volume 3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:33 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-32471ef8-50ca-4f90-bc7d-09bde61d1203 tempest-VolumesGetTest-19209065 None] Lock "cinder-dd3e909b-b699-411a-9197-fbbe3f23849b-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:33 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 1073741824 Jul 08 19:43:33 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:34 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:43:34 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:35 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 1073741824" returned: 0 in 1.079s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:35 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:43:35 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:35 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.046s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:43:35 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 0.779s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260e29fd-2053-4107-9561-081ec340cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709007ce-76e9-42e9-baec-c8c8795c6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:35 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Volume volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 (3e29edc6-30a1-44ef-8c27-a4fdc4db8a56): created successfully Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (709007ce-76e9-42e9-baec-c8c8795c6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (d38e52a5-a573-444c-a974-e057fb09f5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:35 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-93b86bc7-707f-4a46-80f7-86d723b14bec tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (75fcc76b-7f39-4db2-9e38-3143ec3d4347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21fbafd-a5b2-47cf-8187-a63ad004cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21fbafd-a5b2-47cf-8187-a63ad004cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1211507596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a426b1-3a25-46f9-9fde-24243c9487c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3e29edc6-30a1-44ef-8c27-a4fdc4db8a56,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:38Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4be51b-1149-4f4b-b403-79ab8913042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4be51b-1149-4f4b-b403-79ab8913042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad09d151-7a59-4a17-8c19-269cda7a07aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad09d151-7a59-4a17-8c19-269cda7a07aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '83a426b1-3a25-46f9-9fde-24243c9487c1', 'volume_name': 'volume-83a426b1-3a25-46f9-9fde-24243c9487c1', 'volume_size': 1, 'source_volid': '3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'source_volstatus': 'available'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b24cdb-ea6c-4cc8-94e9-6507e32cb697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b24cdb-ea6c-4cc8-94e9-6507e32cb697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9a95c6-39e8-4740-8dc4-70530bf13b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:37 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Volume 83a426b1-3a25-46f9-9fde-24243c9487c1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-83a426b1-3a25-46f9-9fde-24243c9487c1', 'volume_size': 1, 'source_volid': '3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'source_volstatus': 'available'} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:37 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Cloning volume 3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 to volume 83a426b1-3a25-46f9-9fde-24243c9487c1 Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Creating offline snapshot fe90017d-8e0c-48dd-ab29-7e0f8f23c521 of volume 3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f75969-d99a-42ae-ae09-6f1d432a2142]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:38 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:43:38 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Flow 'volume_create_manager' (996c05ab-2639-4ac9-b775-5a72365b6add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e6d0a7-9a8a-41d5-84ed-8b2d7b88db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e6d0a7-9a8a-41d5-84ed-8b2d7b88db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905346104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8491343e-2713-42a0-99da-30db6ce7fb4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499a19e1da8642e4b6a3c70363ec47fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:39Z,use_quota=True,user_id='1a6cc2bbd6eb46d0943dab294224626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9c26f8-d6e1-4c7a-bbad-18c9196d865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9c26f8-d6e1-4c7a-bbad-18c9196d865c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2341e0a-3bce-4a44-973e-fccaf27699e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2341e0a-3bce-4a44-973e-fccaf27699e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8491343e-2713-42a0-99da-30db6ce7fb4c', 'volume_name': 'volume-8491343e-2713-42a0-99da-30db6ce7fb4c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481fee62-e58f-4be2-aa88-c27a3b71eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481fee62-e58f-4be2-aa88-c27a3b71eea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87a2927-46dd-4281-9fdc-cc6ec6906153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:38 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Volume 8491343e-2713-42a0-99da-30db6ce7fb4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8491343e-2713-42a0-99da-30db6ce7fb4c', 'volume_size': 1} Jul 08 19:43:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:39 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 1.135s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:39 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 1G Jul 08 19:43:39 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:40 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 1G" returned: 0 in 1.012s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:40 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 Jul 08 19:43:40 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:40 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:40 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 is being set with open permissions: ugo+rw Jul 08 19:43:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:40 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 Jul 08 19:43:40 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:41 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521" returned: 0 in 0.823s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:41 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info Jul 08 19:43:41 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:42 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info" returned: 0 in 0.802s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:42 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info is being set with open permissions: ugo+rw Jul 08 19:43:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:42 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info Jul 08 19:43:42 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:43 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.info" returned: 0 in 0.993s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-83a426b1-3a25-46f9-9fde-24243c9487c1" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-83a426b1-3a25-46f9-9fde-24243c9487c1" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] snapshot: fe90017d-8e0c-48dd-ab29-7e0f8f23c521, volume: 83a426b1-3a25-46f9-9fde-24243c9487c1, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53faa0-f897-4c3a-b8e2-9661916bcee7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:43 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 Jul 08 19:43:43 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Flow 'volume_create_manager' (bdd1c1ca-0326-40f8-85d8-78adbfd6192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afab1473-25a3-440d-b38e-d245c76bd947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afab1473-25a3-440d-b38e-d245c76bd947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2082396346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd704b2-cee7-4932-8ca3-0bd1ffa51afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5ca5df8b574c4b8120f056d77ebe18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:44Z,use_quota=True,user_id='f98461d16fdb40029054e00603612b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef442a2b-1b25-4c09-b343-2e9bddc1821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef442a2b-1b25-4c09-b343-2e9bddc1821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e630825-36c2-4abc-b951-d9e5d7492c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e630825-36c2-4abc-b951-d9e5d7492c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd704b2-cee7-4932-8ca3-0bd1ffa51afa', 'volume_name': 'volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe20635e-b4ea-497e-a3a4-1b2b701d3af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe20635e-b4ea-497e-a3a4-1b2b701d3af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7d1718-7846-4a66-ba4f-288254fcf72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Volume 4fd704b2-cee7-4932-8ca3-0bd1ffa51afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa', 'volume_size': 1} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:44 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521" returned: 0 in 1.010s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94b509f-7a02-4379-95dc-29d921511e6e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:44 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:43:44 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:45 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 0.896s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:45 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:43:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:45 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 Jul 08 19:43:45 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:51 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1" returned: 0 in 5.993s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba4352-701c-4525-a2e9-1457acb06e89]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:51 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:43:51 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:52 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 1.143s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:52 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:43:52 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Converted 1024.00 MB image at 170.84 MB/s Jul 08 19:43:52 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 is being set with open permissions: ugo+rw Jul 08 19:43:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:52 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 Jul 08 19:43:52 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:53 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1" returned: 0 in 0.747s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-83a426b1-3a25-46f9-9fde-24243c9487c1" released by "_copy_volume_from_snapshot" :: held 9.910s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-fe90017d-8e0c-48dd-ab29-7e0f8f23c521" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-fe90017d-8e0c-48dd-ab29-7e0f8f23c521" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Deleting offline snapshot fe90017d-8e0c-48dd-ab29-7e0f8f23c521 of volume 3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] snapshot_file for this snap is: volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962895e-afaa-40d3-8b82-4b1431be91b2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:53 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 Jul 08 19:43:53 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:54 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=108,cinder:SELECT=65,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:43:54 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521" returned: 0 in 0.904s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:43:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c06e4-bb26-4831-81e4-f4b52c86dc63]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:43:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:54 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:43:54 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:55 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 0.859s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:55 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 Jul 08 19:43:55 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:56 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521" returned: 0 in 0.802s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:56 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521 Jul 08 19:43:56 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:56 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56.fe90017d-8e0c-48dd-ab29-7e0f8f23c521" returned: 0 in 0.644s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-fe90017d-8e0c-48dd-ab29-7e0f8f23c521" released by "_delete_snapshot" :: held 3.322s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.048s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.228s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905346104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8491343e-2713-42a0-99da-30db6ce7fb4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499a19e1da8642e4b6a3c70363ec47fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:39Z,use_quota=True,user_id='1a6cc2bbd6eb46d0943dab294224626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Creating volume 8491343e-2713-42a0-99da-30db6ce7fb4c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:56 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:56 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c 1073741824 Jul 08 19:43:56 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9a95c6-39e8-4740-8dc4-70530bf13b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a426b1-3a25-46f9-9fde-24243c9487c1', 'volume_size': 1, 'source_volid': '3e29edc6-30a1-44ef-8c27-a4fdc4db8a56', 'source_volstatus': 'available'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5de346-4707-4530-bda7-e5f6acdef7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:56 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Volume volume-83a426b1-3a25-46f9-9fde-24243c9487c1 (83a426b1-3a25-46f9-9fde-24243c9487c1): created successfully Jul 08 19:43:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5de346-4707-4530-bda7-e5f6acdef7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (75fcc76b-7f39-4db2-9e38-3143ec3d4347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7c2d2d77-f7ef-42f6-96b0-bbcb834b7652 tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:43:57 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c 1073741824" returned: 0 in 0.990s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:58 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c Jul 08 19:43:58 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (65e7a34e-a3f6-497c-946b-1813502bc9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170c1a69-92c3-45a2-819c-b936dbd9a17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170c1a69-92c3-45a2-819c-b936dbd9a17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1488853717',display_name='tempest-VolumesGetTest-Volume-632841363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f17354d-809c-43aa-bbfd-68961345a655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:58Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397f058d-eba4-443f-8d5d-14f61680c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397f058d-eba4-443f-8d5d-14f61680c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bfdcc6-5919-436c-a789-d613282b12f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bfdcc6-5919-436c-a789-d613282b12f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f17354d-809c-43aa-bbfd-68961345a655', 'volume_name': 'volume-2f17354d-809c-43aa-bbfd-68961345a655', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14dd94a-ebf5-4087-8e2e-3b559bbcbcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14dd94a-ebf5-4087-8e2e-3b559bbcbcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28909e5f-ada6-41d5-9fb1-27eb94beb46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Volume 2f17354d-809c-43aa-bbfd-68961345a655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f17354d-809c-43aa-bbfd-68961345a655', 'volume_size': 1} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:58 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c" returned: 0 in 0.822s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.677s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2082396346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd704b2-cee7-4932-8ca3-0bd1ffa51afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5ca5df8b574c4b8120f056d77ebe18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:44Z,use_quota=True,user_id='f98461d16fdb40029054e00603612b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Creating volume 4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:43:58 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:43:58 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa 1073741824 Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87a2927-46dd-4281-9fdc-cc6ec6906153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8491343e-2713-42a0-99da-30db6ce7fb4c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:58 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df819ef-5863-4aab-b4ac-2c85b5c374fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:43:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Volume volume-8491343e-2713-42a0-99da-30db6ce7fb4c (8491343e-2713-42a0-99da-30db6ce7fb4c): created successfully Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df819ef-5863-4aab-b4ac-2c85b5c374fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:43:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Flow 'volume_create_manager' (996c05ab-2639-4ac9-b775-5a72365b6add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:43:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-684738c5-f60d-4abb-aa22-b77b0cf50c78 tempest-VolumesListTestJSON-1534249423 None] Created volume successfully. Jul 08 19:44:00 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa 1073741824" returned: 0 in 1.234s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=76,cinder:UPDATE=93,cinder:INSERT=23,cinder:DELETE=11 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:00 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:44:00 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Flow 'volume_create_manager' (b532d4bb-8332-4d08-b429-bfef4cd2ae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f69f8a3-f91f-412c-88b7-71420d75ba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f69f8a3-f91f-412c-88b7-71420d75ba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1179204970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499a19e1da8642e4b6a3c70363ec47fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:00Z,use_quota=True,user_id='1a6cc2bbd6eb46d0943dab294224626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580608a8-7895-4f05-9292-aee7c9c69d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580608a8-7895-4f05-9292-aee7c9c69d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b046086a-fa4e-43c2-aca9-25c04b5e8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b046086a-fa4e-43c2-aca9-25c04b5e8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a', 'volume_name': 'volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ee17b3-1fd2-4cc0-9d6f-9b14848502b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ee17b3-1fd2-4cc0-9d6f-9b14848502b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1470325-277e-48d5-802c-d61e232af5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Volume 36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a', 'volume_size': 1} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:00 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 0.739s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:43:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1488853717',display_name='tempest-VolumesGetTest-Volume-632841363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f17354d-809c-43aa-bbfd-68961345a655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:43:58Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Creating volume 2f17354d-809c-43aa-bbfd-68961345a655 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:00 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7d1718-7846-4a66-ba4f-288254fcf72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060828cf-0d41-41d6-98b0-62b59fe7fa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:00 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 1073741824 Jul 08 19:44:00 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Volume volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa (4fd704b2-cee7-4932-8ca3-0bd1ffa51afa): created successfully Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060828cf-0d41-41d6-98b0-62b59fe7fa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Flow 'volume_create_manager' (bdd1c1ca-0326-40f8-85d8-78adbfd6192e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-51bfa91d-8741-4404-b62f-856c651fa08c tempest-VolumesActionsTest-1954504672 None] Created volume successfully. Jul 08 19:44:01 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 1073741824" returned: 0 in 1.085s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:02 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 Jul 08 19:44:02 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:02 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655" returned: 0 in 0.741s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.433s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1179204970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499a19e1da8642e4b6a3c70363ec47fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:00Z,use_quota=True,user_id='1a6cc2bbd6eb46d0943dab294224626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Creating volume 36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:02 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28909e5f-ada6-41d5-9fb1-27eb94beb46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f17354d-809c-43aa-bbfd-68961345a655', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:02 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a 1073741824 Jul 08 19:44:02 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1430040c-a1ce-4281-8eae-d600fd0f1244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:02 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Volume volume-2f17354d-809c-43aa-bbfd-68961345a655 (2f17354d-809c-43aa-bbfd-68961345a655): created successfully Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1430040c-a1ce-4281-8eae-d600fd0f1244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (65e7a34e-a3f6-497c-946b-1813502bc9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6e92851b-6e1b-40b4-9a1e-e0ee8d09f3ea tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:44:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-2f17354d-809c-43aa-bbfd-68961345a655-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Lock "cinder-2f17354d-809c-43aa-bbfd-68961345a655-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-2f17354d-809c-43aa-bbfd-68961345a655" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-2f17354d-809c-43aa-bbfd-68961345a655" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:03 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[219be129-1484-4590-a6e8-73d4d5290194]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:04 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a 1073741824" returned: 0 in 1.249s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:04 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 Jul 08 19:44:04 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:04 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a Jul 08 19:44:04 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:04 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a" returned: 0 in 0.822s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1470325-277e-48d5-802c-d61e232af5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb44890-e4f2-4e86-aa6e-2ecaac4ee331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:04 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Volume volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a (36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a): created successfully Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb44890-e4f2-4e86-aa6e-2ecaac4ee331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Flow 'volume_create_manager' (b532d4bb-8332-4d08-b429-bfef4cd2ae58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9c1a0039-673a-41bd-944a-a6a3f0d9c228 tempest-VolumesListTestJSON-1534249423 None] Created volume successfully. Jul 08 19:44:05 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655" returned: 0 in 1.284s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:05 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655 Jul 08 19:44:05 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:05 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-2f17354d-809c-43aa-bbfd-68961345a655" returned: 0 in 0.709s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-2f17354d-809c-43aa-bbfd-68961345a655" released by "delete_volume" :: held 2.043s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:05 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Created reservations ['f65deaf3-c80a-4da5-b1d3-257110b6db34', 'a20ec17a-185d-4f00-af97-7de3aadae5f3', '4a80b10d-41a7-44c5-8ea1-fa1751385b22', 'aca10ccc-ea26-4178-aa9d-84399ecbe6d5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:06 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:06 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Flow 'volume_create_manager' (458b66bd-4381-45eb-a18a-9c868ab1b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5f49e3-73c5-442a-90c8-5d8cdf6d520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5f49e3-73c5-442a-90c8-5d8cdf6d520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-985284950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9786d29-c851-438a-8a33-6ba845f4486a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499a19e1da8642e4b6a3c70363ec47fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:06Z,use_quota=True,user_id='1a6cc2bbd6eb46d0943dab294224626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b45ec8c-55ce-42ea-bd7c-0135e40b6c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b45ec8c-55ce-42ea-bd7c-0135e40b6c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e8e9fb-d43e-48e9-9660-95ce52847bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e8e9fb-d43e-48e9-9660-95ce52847bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9786d29-c851-438a-8a33-6ba845f4486a', 'volume_name': 'volume-b9786d29-c851-438a-8a33-6ba845f4486a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75532f8-034c-470f-86b1-9d25f73aa209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75532f8-034c-470f-86b1-9d25f73aa209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1ae5f8-0948-494c-ac11-6bb6e41a7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:06 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Volume b9786d29-c851-438a-8a33-6ba845f4486a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9786d29-c851-438a-8a33-6ba845f4486a', 'volume_size': 1} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-985284950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9786d29-c851-438a-8a33-6ba845f4486a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='499a19e1da8642e4b6a3c70363ec47fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:06Z,use_quota=True,user_id='1a6cc2bbd6eb46d0943dab294224626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Creating volume b9786d29-c851-438a-8a33-6ba845f4486a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:06 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:06 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a 1073741824 Jul 08 19:44:06 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:06 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.803s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:44:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d66c1fc6-7d38-47e9-a5a4-4d5c45e951a6 tempest-VolumesGetTest-19209065 None] Lock "cinder-2f17354d-809c-43aa-bbfd-68961345a655-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-83a426b1-3a25-46f9-9fde-24243c9487c1-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Lock "cinder-83a426b1-3a25-46f9-9fde-24243c9487c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-83a426b1-3a25-46f9-9fde-24243c9487c1" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-83a426b1-3a25-46f9-9fde-24243c9487c1" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:07 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a 1073741824" returned: 0 in 1.063s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[822f173f-9e1d-4650-b93e-cb3a5af0be75]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:07 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a Jul 08 19:44:07 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:07 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 Jul 08 19:44:07 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:08 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a" returned: 0 in 0.688s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1ae5f8-0948-494c-ac11-6bb6e41a7e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9786d29-c851-438a-8a33-6ba845f4486a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dc5aca-6eb3-42d9-a0c5-4f91223bef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:08 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Volume volume-b9786d29-c851-438a-8a33-6ba845f4486a (b9786d29-c851-438a-8a33-6ba845f4486a): created successfully Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dc5aca-6eb3-42d9-a0c5-4f91223bef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Flow 'volume_create_manager' (458b66bd-4381-45eb-a18a-9c868ab1b63e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-61e9a385-dbd2-4e97-83b6-f045be35f000 tempest-VolumesListTestJSON-1534249423 None] Created volume successfully. Jul 08 19:44:08 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1" returned: 0 in 1.024s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:08 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1 Jul 08 19:44:08 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Flow 'volume_create_manager' (4f231a12-0619-4f1c-808c-b4739f8f31ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4246c492-d2c6-492a-9a60-f9f8bb9badb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4246c492-d2c6-492a-9a60-f9f8bb9badb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-458177730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8ff574-af10-40a3-aa00-ace2ce540ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8d207f4d3e40b1a31659d0846ae15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:08Z,use_quota=True,user_id='73217613871941b684daf155190e7189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca53b72-839a-487c-aec3-d44c19cc3d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca53b72-839a-487c-aec3-d44c19cc3d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44858098-66da-4184-94fa-1cb475d3b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44858098-66da-4184-94fa-1cb475d3b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8ff574-af10-40a3-aa00-ace2ce540ace', 'volume_name': 'volume-af8ff574-af10-40a3-aa00-ace2ce540ace', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3f5602-9905-44ba-b631-5c449fa8aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3f5602-9905-44ba-b631-5c449fa8aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b786f3fe-289d-4378-94be-ade13a29e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:08 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Volume af8ff574-af10-40a3-aa00-ace2ce540ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8ff574-af10-40a3-aa00-ace2ce540ace', 'volume_size': 1} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-458177730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8ff574-af10-40a3-aa00-ace2ce540ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8d207f4d3e40b1a31659d0846ae15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:08Z,use_quota=True,user_id='73217613871941b684daf155190e7189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Creating volume af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:08 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:08 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace 1073741824 Jul 08 19:44:08 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:09 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-83a426b1-3a25-46f9-9fde-24243c9487c1" returned: 0 in 0.958s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-83a426b1-3a25-46f9-9fde-24243c9487c1" released by "delete_volume" :: held 2.049s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Created reservations ['6b6b5acf-4cac-428d-b0d1-89aeae7e26b6', '12acb175-d0e6-47e3-b136-811944d7a97a', '8a7a0f62-e4c2-4bac-8d25-57dfa8a16d4d', '7b68245f-8dc4-42e3-9828-24f62f5c307e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:09 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:09 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:09 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace 1073741824" returned: 0 in 1.355s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:10 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:44:10 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:10 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.119s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:10 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:44:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b74789b0-663e-4a81-8f0b-237779060e44 tempest-VolumesGetTest-19209065 None] Lock "cinder-83a426b1-3a25-46f9-9fde-24243c9487c1-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Lock "cinder-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" acquired by "delete_volume" :: waited 0.042s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa914e-6ab6-4d86-8066-c6eea5a304c9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:11 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 1.314s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.763s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b786f3fe-289d-4378-94be-ade13a29e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8ff574-af10-40a3-aa00-ace2ce540ace', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1b036e-9824-47dc-acc5-1914b9bcf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:11 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Volume volume-af8ff574-af10-40a3-aa00-ace2ce540ace (af8ff574-af10-40a3-aa00-ace2ce540ace): created successfully Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1b036e-9824-47dc-acc5-1914b9bcf454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Flow 'volume_create_manager' (4f231a12-0619-4f1c-808c-b4739f8f31ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d71c2f6d-82c6-44b3-ae37-6443078c263c tempest-TestStampPattern-1987150457 None] Created volume successfully. Jul 08 19:44:11 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:44:11 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:12 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 1.094s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:12 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56 Jul 08 19:44:12 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "cinder-b9786d29-c851-438a-8a33-6ba845f4486a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-b9786d29-c851-438a-8a33-6ba845f4486a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "cinder-quobyte-b9786d29-c851-438a-8a33-6ba845f4486a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-quobyte-b9786d29-c851-438a-8a33-6ba845f4486a" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00556b2-79cd-4774-916f-bbfca2766f6b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:12 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a Jul 08 19:44:12 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:12 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" returned: 0 in 0.745s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56" released by "delete_volume" :: held 1.953s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Created reservations ['ead044ee-bc0b-48fe-8c1c-2bd21599f2ef', '6dc40cad-73e0-4fdb-803c-dd3513fed547', 'ea7f7764-7e60-4402-bc56-96f23e6baf69', '6bf35015-0cd1-4aca-aa9c-2be21077dfff'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:13 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:13 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:13 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a" returned: 0 in 0.952s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:13 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a Jul 08 19:44:13 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:13 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:13 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ddee1e23-aba8-437c-8450-03763f9fff9b tempest-VolumesGetTest-19209065 None] Lock "cinder-3e29edc6-30a1-44ef-8c27-a4fdc4db8a56-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:14 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b9786d29-c851-438a-8a33-6ba845f4486a" returned: 0 in 0.787s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-quobyte-b9786d29-c851-438a-8a33-6ba845f4486a" released by "delete_volume" :: held 1.796s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Created reservations ['af620384-720d-4262-a266-9e436c2816c8', '2942008e-f699-424c-b578-df8854ec21b2', 'e378b027-02d4-484a-9cbe-d291cbe06bb3', '517430bf-d860-40b5-b0e2-a4148da6fa9c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:14 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:14 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "cinder-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (82b86b6c-3ce1-407c-bffa-2b87cf544311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ae6143-e1dc-4313-9397-904780ba32d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ae6143-e1dc-4313-9397-904780ba32d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1330289001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b698de-dc4c-4266-96b2-9b6505d79ce0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:15Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5f2efd-19bc-4eba-9665-c20dd04138fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5f2efd-19bc-4eba-9665-c20dd04138fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b971e678-1043-4d25-b272-150e152544fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "cinder-quobyte-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-quobyte-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7921f49-5784-4382-9ea9-e6edf5de817f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:14 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a Jul 08 19:44:14 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b971e678-1043-4d25-b272-150e152544fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39b698de-dc4c-4266-96b2-9b6505d79ce0', 'volume_name': 'volume-39b698de-dc4c-4266-96b2-9b6505d79ce0', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34b2d19-4667-427d-a01b-f11b8ae0ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34b2d19-4667-427d-a01b-f11b8ae0ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b776b7a5-dae5-442c-9917-01fc98b2d110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:14 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Volume 39b698de-dc4c-4266-96b2-9b6505d79ce0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39b698de-dc4c-4266-96b2-9b6505d79ce0', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 19:44:14 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Trying to clone 39b698de-dc4c-4266-96b2-9b6505d79ce0 from image 35933816-a0eb-45ed-8ba6-853bccb9e496 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:44:15 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.761s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:15 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Deleted volume successfully. Jul 08 19:44:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cab28cfb-573e-49e6-8cc4-ecc723ae2cd4 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-b9786d29-c851-438a-8a33-6ba845f4486a-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:15 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:44:15 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Image download 20.69 MB at 20.69 MB/s Jul 08 19:44:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe31ab7-2e08-4f7d-9916-7f4d25063dfb]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:15 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD Jul 08 19:44:15 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:16 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a" returned: 0 in 1.317s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:16 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a Jul 08 19:44:16 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:16 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD" returned: 0 in 1.311s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:16 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 is fetched for user 88aa4d143c004c6499fcf5fd44c8aedb. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2aa7b5-f581-4981-8397-5e1ef38ef2d1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:17 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD Jul 08 19:44:17 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:17 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a" returned: 0 in 1.190s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-quobyte-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a" released by "delete_volume" :: held 2.576s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Created reservations ['0f19a70c-e712-494e-b153-5303a7d3140d', '070e70d1-e0e1-4fff-8080-8696da31844c', '8733b49a-dfb2-4634-9051-c23d9fd7da50', '0beab8b2-d0dd-40c9-88f3-1635e769292d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:17 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:17 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "cinder-8491343e-2713-42a0-99da-30db6ce7fb4c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-8491343e-2713-42a0-99da-30db6ce7fb4c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "cinder-quobyte-8491343e-2713-42a0-99da-30db6ce7fb4c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-quobyte-8491343e-2713-42a0-99da-30db6ce7fb4c" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed588bdc-1147-4fbe-a1b3-7d7d722611fb]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:18 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:18 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c Jul 08 19:44:18 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD" returned: 0 in 1.483s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1330289001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b698de-dc4c-4266-96b2-9b6505d79ce0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:15Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Creating volume 39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:18 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:18 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 1073741824 Jul 08 19:44:18 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:19 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.705s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:19 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Deleted volume successfully. Jul 08 19:44:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-90381cca-88eb-4e87-b38c-8c3889643936 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-36a9957f-84d3-4ea6-8d5e-e846ce5d9d8a-delete_volume" released by "delete_volume" :: held 4.667s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:19 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c" returned: 0 in 1.429s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:19 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c Jul 08 19:44:19 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:20 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 1073741824" returned: 0 in 1.779s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:20 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:20 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f876a716-d14b-4b8a-bc60-47528cffff9e tempest-VolumesActionsTest-1954504672 None] Acquiring lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" by "attach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f876a716-d14b-4b8a-bc60-47528cffff9e tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" acquired by "attach_volume" :: waited 0.038s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f876a716-d14b-4b8a-bc60-47528cffff9e tempest-VolumesActionsTest-1954504672 None] Attaching volume 4fd704b2-cee7-4932-8ca3-0bd1ffa51afa to instance 45766041-0e19-429c-a6bb-2a058ba4af9a at mountpoint /dev/vdb on host None. Jul 08 19:44:20 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8491343e-2713-42a0-99da-30db6ce7fb4c" returned: 0 in 0.967s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-quobyte-8491343e-2713-42a0-99da-30db6ce7fb4c" released by "delete_volume" :: held 2.501s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f876a716-d14b-4b8a-bc60-47528cffff9e tempest-VolumesActionsTest-1954504672 None] Attach volume completed successfully. Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f876a716-d14b-4b8a-bc60-47528cffff9e tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" released by "attach_volume" :: held 0.194s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Created reservations ['c5fec93e-306a-4c28-af41-4a290d0e7001', '3cf8dafb-aed6-4018-b721-86b6a8300135', 'c98b2bac-3d74-44dc-9196-c52366b3f1a1', '954e56fe-f4cd-469a-a4e2-eb34dc68ed72'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:20 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:20 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a8f16ed-1bc6-4101-91fb-01f8bd74a40e tempest-VolumesActionsTest-1954504672 None] Acquiring lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-detach_volume" by "detach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a8f16ed-1bc6-4101-91fb-01f8bd74a40e tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2a8f16ed-1bc6-4101-91fb-01f8bd74a40e tempest-VolumesActionsTest-1954504672 None] Detaching volume 4fd704b2-cee7-4932-8ca3-0bd1ffa51afa from instance 45766041-0e19-429c-a6bb-2a058ba4af9a. Jul 08 19:44:21 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 0 in 1.001s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] <== create_volume: return (2854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.863s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2a8f16ed-1bc6-4101-91fb-01f8bd74a40e tempest-VolumesActionsTest-1954504672 None] Detach volume completed successfully. Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2a8f16ed-1bc6-4101-91fb-01f8bd74a40e tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-detach_volume" released by "detach_volume" :: held 0.156s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Attempting download of 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume 39b698de-dc4c-4266-96b2-9b6505d79ce0. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8e935-2fff-43be-b73c-b994c36e3f5e]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:21 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.737s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Deleted volume successfully. Jul 08 19:44:21 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b Jul 08 19:44:21 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-87801571-4b88-4727-89c1-ca86a9e9f378 tempest-VolumesListTestJSON-1534249423 None] Lock "cinder-8491343e-2713-42a0-99da-30db6ce7fb4c-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:22 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b" returned: 0 in 1.188s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:22 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b Jul 08 19:44:22 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:23 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b" returned: 1 in 0.979s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_yjo4r61b' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:44:23 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09e8382-2c70-4070-b260-f16295748d31]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:23 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD Jul 08 19:44:23 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:24 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD" returned: 0 in 1.167s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:24 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] 35933816-a0eb-45ed-8ba6-853bccb9e496 was qcow2, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:44:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:24 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:24 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Flow 'volume_create_manager' (5c5a46cd-8ae6-4965-b1da-41998c52d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6209a0aa-78ed-453a-bf94-8f72b57b7c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6209a0aa-78ed-453a-bf94-8f72b57b7c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-411625391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9d84b1e8ac44188980de50d9ccadb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:27Z,use_quota=True,user_id='2f2f589238954e77ab8d2206c6337fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568dec87-84a8-4ff4-92ef-7a56f7d6f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568dec87-84a8-4ff4-92ef-7a56f7d6f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edb4606-3267-45d3-b0b1-889234e92b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edb4606-3267-45d3-b0b1-889234e92b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7', 'volume_name': 'volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7', 'volume_size': 2}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898c880b-bf73-4a5d-84d5-fa0ceedeef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898c880b-bf73-4a5d-84d5-fa0ceedeef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccab5ae2-f7f5-4ac7-b1f7-425c88b44e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Volume f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7', 'volume_size': 2} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-411625391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9d84b1e8ac44188980de50d9ccadb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:27Z,use_quota=True,user_id='2f2f589238954e77ab8d2206c6337fd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Creating volume f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:26 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 2147483648 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:27 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 2147483648 Jul 08 19:44:27 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:27 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 0 in 2.891s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:27 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ah3l47padevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:44:27 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Converted 112.00 MB image at 38.72 MB/s Jul 08 19:44:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:27 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 1G Jul 08 19:44:27 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:28 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 2147483648" returned: 0 in 1.281s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:28 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 Jul 08 19:44:28 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:28 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 1G" returned: 0 in 0.873s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b98bb8-208f-4265-a4dd-c556031ea1ed]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:28 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:28 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:29 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" returned: 0 in 1.020s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccab5ae2-f7f5-4ac7-b1f7-425c88b44e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7', 'volume_size': 2}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eadb6d-d4a3-46de-9350-ad836f037af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:29 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Volume volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 (f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7): created successfully Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eadb6d-d4a3-46de-9350-ad836f037af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Flow 'volume_create_manager' (5c5a46cd-8ae6-4965-b1da-41998c52d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-45761b0d-173f-4859-bc76-6f8938b736e2 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Created volume successfully. Jul 08 19:44:29 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 0 in 1.228s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:30 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:30 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Creating offline snapshot 3ea59663-4886-40b5-9d1d-504f174a1bd6 of volume f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:44:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852688b-a234-4e7d-bccb-2b0a769fba90]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:30 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 Jul 08 19:44:30 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:31 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" returned: 0 in 1.003s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 2G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:31 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 1 in 1.584s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Downloaded image 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume 39b698de-dc4c-4266-96b2-9b6505d79ce0 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 for user 88aa4d143c004c6499fcf5fd44c8aedb is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Marking volume 39b698de-dc4c-4266-96b2-9b6505d79ce0 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:44:31 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 2G Jul 08 19:44:31 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Copying metadata from image 35933816-a0eb-45ed-8ba6-853bccb9e496 to 39b698de-dc4c-4266-96b2-9b6505d79ce0. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Creating volume glance metadata for volume 39b698de-dc4c-4266-96b2-9b6505d79ce0 backed by image 35933816-a0eb-45ed-8ba6-853bccb9e496 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b776b7a5-dae5-442c-9917-01fc98b2d110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b698de-dc4c-4266-96b2-9b6505d79ce0', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6231ab5c-3215-46af-9d64-3114660b4b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Volume volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 (39b698de-dc4c-4266-96b2-9b6505d79ce0): created successfully Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6231ab5c-3215-46af-9d64-3114660b4b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (82b86b6c-3ce1-407c-bffa-2b87cf544311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:31 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b39b412f-55ad-47c2-9521-92478f7101d9 tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:44:32 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 2G" returned: 0 in 1.305s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:32 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 Jul 08 19:44:32 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (ab872589-76ee-41b4-bedb-38472e95a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2148b7a5-ce0f-4ee4-862a-c5cfe8e6ff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2148b7a5-ce0f-4ee4-862a-c5cfe8e6ff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1388025684',display_name='tempest-VolumesGetTest-Volume-1268951953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b09a9eb-06c5-4490-9851-17c13ec354ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:33Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba44a2f1-4fa5-49c2-a1c7-bad16d0a69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba44a2f1-4fa5-49c2-a1c7-bad16d0a69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3336590a-918a-424b-ba16-da65d0f3d84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3336590a-918a-424b-ba16-da65d0f3d84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b09a9eb-06c5-4490-9851-17c13ec354ea', 'volume_name': 'volume-5b09a9eb-06c5-4490-9851-17c13ec354ea', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50cad91-cd35-4a46-806a-93afc8be0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50cad91-cd35-4a46-806a-93afc8be0d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ea6ffd-4af9-4f1f-aa4c-c22a4b605e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:33 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Volume 5b09a9eb-06c5-4490-9851-17c13ec354ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b09a9eb-06c5-4490-9851-17c13ec354ea', 'volume_size': 1} Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:33 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6" returned: 0 in 0.989s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:33 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 is being set with open permissions: ugo+rw Jul 08 19:44:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:33 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 Jul 08 19:44:33 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:34 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6" returned: 0 in 0.822s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:34 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info Jul 08 19:44:34 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:34 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:34 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:35 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info" returned: 0 in 0.655s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:35 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info is being set with open permissions: ugo+rw Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:35 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.650s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:44:35 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info Jul 08 19:44:35 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:44:36 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.info" returned: 0 in 0.733s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.649s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.418s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1388025684',display_name='tempest-VolumesGetTest-Volume-1268951953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b09a9eb-06c5-4490-9851-17c13ec354ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94413bee43d74269b5615111a620520f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:33Z,use_quota=True,user_id='88aa4d143c004c6499fcf5fd44c8aedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Creating volume 5b09a9eb-06c5-4490-9851-17c13ec354ea {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:36 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:36 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea 1073741824 Jul 08 19:44:36 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-64eecf73-b2d8-4651-9fd7-8fcbd4038538 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Create snapshot completed successfully Jul 08 19:44:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "cinder-3ea59663-4886-40b5-9d1d-504f174a1bd6-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-3ea59663-4886-40b5-9d1d-504f174a1bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "cinder-quobyte-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-quobyte-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" acquired by "delete_snapshot" :: waited 0.126s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "cinder-quobyte-3ea59663-4886-40b5-9d1d-504f174a1bd6" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-quobyte-3ea59663-4886-40b5-9d1d-504f174a1bd6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Deleting offline snapshot 3ea59663-4886-40b5-9d1d-504f174a1bd6 of volume f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] snapshot_file for this snap is: volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f82b7de-614c-4dd6-a0fe-bf30b2a0fe7d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:37 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea 1073741824" returned: 0 in 1.315s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:37 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 Jul 08 19:44:37 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:37 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea Jul 08 19:44:37 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:38 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea" returned: 0 in 1.127s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] <== create_volume: return (2530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.533s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ea6ffd-4af9-4f1f-aa4c-c22a4b605e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b09a9eb-06c5-4490-9851-17c13ec354ea', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39ede55-d48e-4b18-a098-15ffeb268e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:38 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Volume volume-5b09a9eb-06c5-4490-9851-17c13ec354ea (5b09a9eb-06c5-4490-9851-17c13ec354ea): created successfully Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39ede55-d48e-4b18-a098-15ffeb268e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:38 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Flow 'volume_create_manager' (ab872589-76ee-41b4-bedb-38472e95a89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6" returned: 0 in 1.526s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:44:38 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-28638bb0-ec92-4d63-9511-6e1875efb1b2 tempest-VolumesGetTest-19209065 None] Created volume successfully. Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[99306517-73d7-437b-8f85-cca26fae3844]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:38 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 Jul 08 19:44:38 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-5b09a9eb-06c5-4490-9851-17c13ec354ea-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Lock "cinder-5b09a9eb-06c5-4490-9851-17c13ec354ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-5b09a9eb-06c5-4490-9851-17c13ec354ea" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-5b09a9eb-06c5-4490-9851-17c13ec354ea" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ebce2-8c42-444d-a252-3c9a0124bcc8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:39 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea Jul 08 19:44:39 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:39 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" returned: 0 in 0.896s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:39 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 Jul 08 19:44:39 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:39 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea" returned: 0 in 0.772s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:39 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea Jul 08 19:44:39 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:40 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6" returned: 0 in 0.762s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:40 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6 Jul 08 19:44:40 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:40 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5b09a9eb-06c5-4490-9851-17c13ec354ea" returned: 0 in 0.677s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-5b09a9eb-06c5-4490-9851-17c13ec354ea" released by "delete_volume" :: held 1.503s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Created reservations ['ad8ae7ff-5440-44bf-9480-ab0e3a377c96', '12988b32-7ef1-479b-91a4-a90a3a14f6c6', 'a92ad693-6df8-47f0-b451-df42903303ea', '8c5fd247-cc74-4f3e-8f60-e51ff6d61cc2'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:40 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:40 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:41 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7.3ea59663-4886-40b5-9d1d-504f174a1bd6" returned: 0 in 0.674s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-quobyte-3ea59663-4886-40b5-9d1d-504f174a1bd6" released by "_delete_snapshot" :: held 4.070s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-quobyte-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" released by "delete_snapshot" :: held 4.106s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Created reservations ['511a1994-f328-4040-a580-e2edfe42207c', '84b0f33b-bf55-4f55-8225-be0ca0117f57', 'c8c23ad3-2fab-4f7f-9c89-0815b75a82e7', '3346b7df-dd54-4a0f-bf9d-c61fc2f052c9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Delete snapshot completed successfully. Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-39b698de-dc4c-4266-96b2-9b6505d79ce0-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2504b6e5-f3de-4227-862c-4194f955eb39 tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-3ea59663-4886-40b5-9d1d-504f174a1bd6-delete_snapshot" released by "delete_snapshot" :: held 4.424s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Lock "cinder-39b698de-dc4c-4266-96b2-9b6505d79ce0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:41 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.693s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Acquiring lock "cinder-quobyte-39b698de-dc4c-4266-96b2-9b6505d79ce0" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-903e0efe-6db0-4982-8dc8-6e1a6e736428 tempest-VolumesGetTest-19209065 None] Lock "cinder-5b09a9eb-06c5-4490-9851-17c13ec354ea-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-39b698de-dc4c-4266-96b2-9b6505d79ce0" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b2736-ab8f-47e1-932d-12c4077215ea]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:41 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:41 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:42 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 0 in 0.716s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:42 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:42 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "cinder-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "cinder-quobyte-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-quobyte-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[53013606-fdeb-4c1e-93a0-53fc202954cd]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:42 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 Jul 08 19:44:42 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:43 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 1 in 1.007s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:44:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:43 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0 Jul 08 19:44:43 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:43 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" returned: 0 in 1.074s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:43 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7 Jul 08 19:44:43 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:44 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-39b698de-dc4c-4266-96b2-9b6505d79ce0" returned: 0 in 0.720s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Lock "cinder-quobyte-39b698de-dc4c-4266-96b2-9b6505d79ce0" released by "delete_volume" :: held 2.518s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Created reservations ['6fb2c098-c6b5-4a01-8e9f-f092169e295e', '0e316659-281f-46df-9751-e8da0513d8dd', '942fc86c-2b7a-46d3-8f0e-d19b1074ceb6', '4f9e098f-b47c-4ca2-92ff-a8e44d1eecc7'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:44 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:44 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:44 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" returned: 0 in 0.660s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-quobyte-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7" released by "delete_volume" :: held 1.801s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Created reservations ['67295002-a8c7-4a23-99a2-fb65ce8d47af', 'b6a9946c-1838-4946-b0ff-e4f7ca80151b', '0c1301f5-e3c4-4932-9520-d99ae1a64925', '03fc7e4f-33bf-4d8e-bb3e-d3d100e3ba46'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:44 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:44:44 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:44 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.787s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:44 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Deleted volume successfully. Jul 08 19:44:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ed6af55b-21ec-4f50-b796-b94df40a7425 tempest-VolumesGetTest-19209065 None] Lock "cinder-39b698de-dc4c-4266-96b2-9b6505d79ce0-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:45 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.929s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:45 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:44:45 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Deleted volume successfully. Jul 08 19:44:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a08bb84a-772d-48ed-9aad-65046c60229e tempest-VolumesSnapshotNegativeTestJSON-196543363 None] Lock "cinder-f2e9e8c7-9d22-4d9b-b2ea-3011c8c577c7-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a3385769-f093-4004-a534-5e1bc0e0820b tempest-VolumesActionsTest-1954504672 None] Acquiring lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" by "attach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a3385769-f093-4004-a534-5e1bc0e0820b tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" acquired by "attach_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a3385769-f093-4004-a534-5e1bc0e0820b tempest-VolumesActionsTest-1954504672 None] Attaching volume 4fd704b2-cee7-4932-8ca3-0bd1ffa51afa to instance e7c0e47b-c943-4709-b290-41652a056da4 at mountpoint /dev/vdb on host None. Jul 08 19:44:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a3385769-f093-4004-a534-5e1bc0e0820b tempest-VolumesActionsTest-1954504672 None] Attach volume completed successfully. Jul 08 19:44:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a3385769-f093-4004-a534-5e1bc0e0820b tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" released by "attach_volume" :: held 0.195s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-55b5abbe-4616-41af-91a4-365851bd8bf6 tempest-VolumesActionsTest-1954504672 None] Acquiring lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-detach_volume" by "detach_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:44:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-55b5abbe-4616-41af-91a4-365851bd8bf6 tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:44:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-55b5abbe-4616-41af-91a4-365851bd8bf6 tempest-VolumesActionsTest-1954504672 None] Detaching volume 4fd704b2-cee7-4932-8ca3-0bd1ffa51afa from instance e7c0e47b-c943-4709-b290-41652a056da4. Jul 08 19:44:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-55b5abbe-4616-41af-91a4-365851bd8bf6 tempest-VolumesActionsTest-1954504672 None] Detach volume completed successfully. Jul 08 19:44:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-55b5abbe-4616-41af-91a4-365851bd8bf6 tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Flow 'volume_create_manager' (ad3c0d67-8ea8-406c-abf8-5d360ee74ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23312e7b-9687-4a07-b91e-c244489fbb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23312e7b-9687-4a07-b91e-c244489fbb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1895082904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72cdda2-41ac-49b1-b3f3-e5386b1452dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5857ed5a2c4dff84a26126a7745a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:51Z,use_quota=True,user_id='2b14530909014d1595187c6a8cb78df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4c0a7e-de75-404d-a475-b89b673f5e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4c0a7e-de75-404d-a475-b89b673f5e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8158f5f3-65c9-494a-8747-502a6e454f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8158f5f3-65c9-494a-8747-502a6e454f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72cdda2-41ac-49b1-b3f3-e5386b1452dd', 'volume_name': 'volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0097ab45-90fe-4402-b93d-2135f4b358c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0097ab45-90fe-4402-b93d-2135f4b358c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41982c1-cfdb-4c83-adaa-c695bd9ccd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:50 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Volume b72cdda2-41ac-49b1-b3f3-e5386b1452dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd', 'volume_size': 1} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1895082904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72cdda2-41ac-49b1-b3f3-e5386b1452dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5857ed5a2c4dff84a26126a7745a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:44:51Z,use_quota=True,user_id='2b14530909014d1595187c6a8cb78df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Creating volume b72cdda2-41ac-49b1-b3f3-e5386b1452dd {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:44:50 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:44:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:51 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd 1073741824 Jul 08 19:44:51 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:51 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd 1073741824" returned: 0 in 1.000s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:52 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd Jul 08 19:44:52 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:52 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41982c1-cfdb-4c83-adaa-c695bd9ccd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89bc0db-6f78-4aaa-b469-c53a930012e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:44:52 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Volume volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd (b72cdda2-41ac-49b1-b3f3-e5386b1452dd): created successfully Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89bc0db-6f78-4aaa-b469-c53a930012e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:44:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Flow 'volume_create_manager' (ad3c0d67-8ea8-406c-abf8-5d360ee74ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:44:52 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2406f446-5c84-4472-8e3e-91b5ae68720f tempest-VolumesNegativeTest-1542422432 None] Created volume successfully. Jul 08 19:44:56 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=127,cinder:SELECT=90,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:44:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:44:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:44:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d027b4-0152-4a83-af70-f14c874d9830]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:44:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:44:56 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:44:56 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:44:57 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 08 19:44:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 0.948s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:44:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.983s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:44:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-af8ff574-af10-40a3-aa00-ace2ce540ace', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f97eeb9-8d9c-4b6d-9417-085257d0ec7d', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:44:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-ecb423ae-01e8-44aa-a906-ba7ab8c79899 req-d8bfd465-af2f-4a9b-b169-a686258cea93 tempest-TestStampPattern-1987150457 None] attachment_update completed successfully. Jul 08 19:45:00 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=110,cinder:SELECT=99,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:45:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a296cc1-0ac6-4c77-9837-0260ac0c29cc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:00 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:45:00 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:01 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 1.007s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94b06a4-06de-4bc7-b296-5822125c7131]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:01 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:45:01 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:02 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 1.023s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.44b188cf-f683-46e9-be2a-b8bac7f5f5d8qjlxnst_.img {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:02 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.44b188cf-f683-46e9-be2a-b8bac7f5f5d8qjlxnst_.img Jul 08 19:45:02 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:07 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:45:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-12ffa835-b341-424a-ab02-12b5fc5635a9 req-b6dd6b1f-5522-4ae8-8307-9370e76163d0 tempest-TestStampPattern-1987150457 None] Terminate volume connection completed successfully. Jul 08 19:45:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-12ffa835-b341-424a-ab02-12b5fc5635a9 req-b6dd6b1f-5522-4ae8-8307-9370e76163d0 tempest-TestStampPattern-1987150457 None] Deleting attachment 2f97eeb9-8d9c-4b6d-9417-085257d0ec7d. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:45:09 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.44b188cf-f683-46e9-be2a-b8bac7f5f5d8qjlxnst_.img" returned: 0 in 6.604s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:09 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b5906-233d-4caa-934b-7cc62099befe]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:09 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:45:09 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:10 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 1.277s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:10 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.44b188cf-f683-46e9-be2a-b8bac7f5f5d8qjlxnst_.img {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:45:10 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Converted 1024.00 MB image at 155.04 MB/s Jul 08 19:45:10 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] 44b188cf-f683-46e9-be2a-b8bac7f5f5d8 was raw, no need to convert to raw {{(pid=87172) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jul 08 19:45:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:20 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=3 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:45:20 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Flow 'volume_create_manager' (599cc7db-ad9d-42a8-8776-02616f109fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d145824f-e795-460f-b6d4-4a00a7e1d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d145824f-e795-460f-b6d4-4a00a7e1d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-439371105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33086738-322b-44fc-8fd6-3e97f6aca5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e999f06664a95a03886e2475b8e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:22Z,use_quota=True,user_id='6c9d1d0916fa4eeeb4a3a1e386bfc6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0233d7a7-c6c2-4e0e-899f-43aa8a5aec98),volume_type_id=0233d7a7-c6c2-4e0e-899f-43aa8a5aec98)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a496d2c-f56b-480b-aec2-0e903c2ea6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a496d2c-f56b-480b-aec2-0e903c2ea6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12daa8ee-c38f-478f-bb58-4672b5f39b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12daa8ee-c38f-478f-bb58-4672b5f39b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33086738-322b-44fc-8fd6-3e97f6aca5b3', 'volume_name': 'volume-33086738-322b-44fc-8fd6-3e97f6aca5b3', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a96af31-c49d-4f56-a592-5048d0dcc884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a96af31-c49d-4f56-a592-5048d0dcc884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcba4bc-6040-445f-829c-959afbb333fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume 33086738-322b-44fc-8fd6-3e97f6aca5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33086738-322b-44fc-8fd6-3e97f6aca5b3', 'volume_size': 1} Jul 08 19:45:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Flow 'volume_create_manager' (2e438649-3d5b-48cc-a534-752b9f629654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1d3ece-dc43-4c64-a6b8-c2b38c5a494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1d3ece-dc43-4c64-a6b8-c2b38c5a494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-981134446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345e7ce0-d1de-4e0c-95b3-44e417dac524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e999f06664a95a03886e2475b8e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:23Z,use_quota=True,user_id='6c9d1d0916fa4eeeb4a3a1e386bfc6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc092b3-3363-4e8f-8874-e67a9fa92954),volume_type_id=0cc092b3-3363-4e8f-8874-e67a9fa92954)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9349633e-5464-4e0a-b350-eab881e04c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9349633e-5464-4e0a-b350-eab881e04c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a5dae1-5e7a-499f-aa8e-966baea651f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a5dae1-5e7a-499f-aa8e-966baea651f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345e7ce0-d1de-4e0c-95b3-44e417dac524', 'volume_name': 'volume-345e7ce0-d1de-4e0c-95b3-44e417dac524', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ee8b70-58b3-4727-b493-9ddc20d69091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ee8b70-58b3-4727-b493-9ddc20d69091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09fb88-3a85-4683-ba38-974950b5f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:23 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume 345e7ce0-d1de-4e0c-95b3-44e417dac524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345e7ce0-d1de-4e0c-95b3-44e417dac524', 'volume_size': 1} Jul 08 19:45:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Flow 'volume_create_manager' (df586a88-3d35-4b9c-8449-d81ffadbb182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342a5fad-ccbf-4aff-ad31-588c5de4c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342a5fad-ccbf-4aff-ad31-588c5de4c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-720651316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5365ad86-6bab-4e88-84a9-0a4ac2092142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e999f06664a95a03886e2475b8e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:25Z,use_quota=True,user_id='6c9d1d0916fa4eeeb4a3a1e386bfc6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4edb2517-377c-4213-8163-11660806e480),volume_type_id=4edb2517-377c-4213-8163-11660806e480)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ce6895-4dca-41a2-986a-a8a750462b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ce6895-4dca-41a2-986a-a8a750462b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4f4284-5446-4960-889f-37d49bc61b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:25 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:45:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4f4284-5446-4960-889f-37d49bc61b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5365ad86-6bab-4e88-84a9-0a4ac2092142', 'volume_name': 'volume-5365ad86-6bab-4e88-84a9-0a4ac2092142', 'volume_size': 1, 'image_id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543831539', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c2e999f06664a95a03886e2475b8e01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'created_at': datetime.datetime(2026, 7, 8, 17, 45, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3/file', 'properties': {}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275a8506-296f-4318-8609-d04b47f5cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275a8506-296f-4318-8609-d04b47f5cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc51e0a-b9a8-4f4b-bfb9-019c1d9cb0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume 5365ad86-6bab-4e88-84a9-0a4ac2092142: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5365ad86-6bab-4e88-84a9-0a4ac2092142', 'volume_size': 1, 'image_id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543831539', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c2e999f06664a95a03886e2475b8e01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'created_at': datetime.datetime(2026, 7, 8, 17, 45, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3/file', 'properties': {}}, 'image_service': } Jul 08 19:45:27 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Trying to clone 5365ad86-6bab-4e88-84a9-0a4ac2092142 from image d141ddda-9299-4258-ae60-b1ee27bb6cb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Acquiring lock "cinder-b72cdda2-41ac-49b1-b3f3-e5386b1452dd-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Lock "cinder-b72cdda2-41ac-49b1-b3f3-e5386b1452dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Acquiring lock "cinder-quobyte-b72cdda2-41ac-49b1-b3f3-e5386b1452dd" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Lock "cinder-quobyte-b72cdda2-41ac-49b1-b3f3-e5386b1452dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c351924b-45b3-4287-9c0f-a27e70ce59a1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD, size 20.69 MB, duration 4.21 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:45:31 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Image download 20.69 MB at 4.91 MB/s Jul 08 19:45:31 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd Jul 08 19:45:31 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca1eb27-e825-4c5e-b7c5-e74a7e193ea6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:32 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD Jul 08 19:45:32 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:32 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd" returned: 0 in 0.889s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:32 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd Jul 08 19:45:32 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:32 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:32 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Temporary image d141ddda-9299-4258-ae60-b1ee27bb6cb3 is fetched for user 6c9d1d0916fa4eeeb4a3a1e386bfc6dc. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:45:32 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f57ec5f-22aa-4d04-acf8-84a422be72f1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:33 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD Jul 08 19:45:33 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:33 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b72cdda2-41ac-49b1-b3f3-e5386b1452dd" returned: 0 in 0.829s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Lock "cinder-quobyte-b72cdda2-41ac-49b1-b3f3-e5386b1452dd" released by "delete_volume" :: held 1.797s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Created reservations ['24df32ba-46f0-4a58-a9de-8de428a3e9c3', '2b480c16-7cb6-4086-a3b8-f588883a9feb', '51c70acf-2c5b-42c1-af2a-fb3b01495c62', '16873e69-ef0e-43db-9462-5b2fd3311e75'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:33 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:45:33 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:33 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:34 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:45:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Deleted volume successfully. Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e4a64f9e-ea02-460d-877e-5c282085a8ba tempest-VolumesNegativeTest-1542422432 None] Lock "cinder-b72cdda2-41ac-49b1-b3f3-e5386b1452dd-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.043s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Uploaded volume to glance image-id: 44b188cf-f683-46e9-be2a-b8bac7f5f5d8. {{(pid=87172) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 23.974s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Creating offline snapshot 737f3559-3ead-4e12-916f-1a6dc382dbbe of volume af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:45:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0d220439-dc9b-4ae9-a21a-b16828ae9eba tempest-VolumesActionsTest-1954504672 None] Copy volume to image completed successfully. Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0822ed28-9f9f-41e6-bc7d-66fb9feba83f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:34 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:45:34 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:34 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:45:34 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:35 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.764s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:45:35 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 0.889s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:35 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe 1G Jul 08 19:45:35 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:36 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe 1G" returned: 0 in 0.898s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8ff574-af10-40a3-aa00-ace2ce540ace -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:36 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8ff574-af10-40a3-aa00-ace2ce540ace -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe Jul 08 19:45:36 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:37 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8ff574-af10-40a3-aa00-ace2ce540ace -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe" returned: 0 in 0.762s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:37 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe is being set with open permissions: ugo+rw Jul 08 19:45:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:37 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe Jul 08 19:45:37 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:37 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe" returned: 0 in 0.657s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:37 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info Jul 08 19:45:37 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:38 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info" returned: 0 in 0.778s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:38 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info is being set with open permissions: ugo+rw Jul 08 19:45:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:38 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info Jul 08 19:45:38 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:39 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.info" returned: 0 in 0.692s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.808s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.880s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-439371105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33086738-322b-44fc-8fd6-3e97f6aca5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e999f06664a95a03886e2475b8e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:22Z,use_quota=True,user_id='6c9d1d0916fa4eeeb4a3a1e386bfc6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0233d7a7-c6c2-4e0e-899f-43aa8a5aec98),volume_type_id=0233d7a7-c6c2-4e0e-899f-43aa8a5aec98)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Creating volume 33086738-322b-44fc-8fd6-3e97f6aca5b3 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:45:39 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:45:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:39 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 1073741824 Jul 08 19:45:39 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7d2f528f-8e4d-4cb4-a6a2-a493843408f0 tempest-TestStampPattern-1987150457 None] Create snapshot completed successfully Jul 08 19:45:40 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 1073741824" returned: 0 in 1.007s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:40 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 Jul 08 19:45:40 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:41 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3" returned: 0 in 0.650s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.488s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-981134446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345e7ce0-d1de-4e0c-95b3-44e417dac524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e999f06664a95a03886e2475b8e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:23Z,use_quota=True,user_id='6c9d1d0916fa4eeeb4a3a1e386bfc6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc092b3-3363-4e8f-8874-e67a9fa92954),volume_type_id=0cc092b3-3363-4e8f-8874-e67a9fa92954)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Creating volume 345e7ce0-d1de-4e0c-95b3-44e417dac524 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:45:41 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afcba4bc-6040-445f-829c-959afbb333fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33086738-322b-44fc-8fd6-3e97f6aca5b3', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:41 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 1073741824 Jul 08 19:45:41 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90a0207-0af0-47bf-98c5-e8733987f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 (33086738-322b-44fc-8fd6-3e97f6aca5b3): created successfully Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90a0207-0af0-47bf-98c5-e8733987f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Flow 'volume_create_manager' (599cc7db-ad9d-42a8-8776-02616f109fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-988e7cf5-0320-4b23-888b-5713ede5458f tempest-TestInstancesWithCinderVolumes-1562878143 None] Created volume successfully. Jul 08 19:45:42 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 1073741824" returned: 0 in 1.076s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:42 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 Jul 08 19:45:42 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:42 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524" returned: 0 in 0.695s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.225s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-720651316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5365ad86-6bab-4e88-84a9-0a4ac2092142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e999f06664a95a03886e2475b8e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:25Z,use_quota=True,user_id='6c9d1d0916fa4eeeb4a3a1e386bfc6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4edb2517-377c-4213-8163-11660806e480),volume_type_id=4edb2517-377c-4213-8163-11660806e480)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Creating volume 5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:45:43 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09fb88-3a85-4683-ba38-974950b5f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345e7ce0-d1de-4e0c-95b3-44e417dac524', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cd7c75-2af3-4db8-8ad2-a5da0926984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:43 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 1073741824 Jul 08 19:45:43 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:43 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 (345e7ce0-d1de-4e0c-95b3-44e417dac524): created successfully Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cd7c75-2af3-4db8-8ad2-a5da0926984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Flow 'volume_create_manager' (2e438649-3d5b-48cc-a534-752b9f629654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-49d58ede-c626-455e-a8ce-619755e58d97 tempest-TestInstancesWithCinderVolumes-1562878143 None] Created volume successfully. Jul 08 19:45:44 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 1073741824" returned: 0 in 1.025s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:44 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:45:44 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:44 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 0 in 0.696s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.491s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe578b3d-6726-4b1f-b113-890b7f2f2532]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Attempting download of d141ddda-9299-4258-ae60-b1ee27bb6cb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3', 'metadata': {}}])) to volume 5365ad86-6bab-4e88-84a9-0a4ac2092142. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741fb16-bebf-429f-9aa3-195c792fc937]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:44 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:45:44 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:45 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296 Jul 08 19:45:45 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:45 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296" returned: 0 in 0.959s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:45 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 1.092s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:45 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62bcd6-13e3-490e-816e-9f943b4f39f0]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:46 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296 Jul 08 19:45:46 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:46 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:45:46 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:46 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296" returned: 1 in 0.833s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d141ddda-9299-4258-ae60-b1ee27bb6cb3_p0trg296' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:45:46 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591297c-2816-41f4-80cc-9cb6d39e2e97]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:46 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD Jul 08 19:45:46 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:46 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 0.967s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:46 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img Jul 08 19:45:46 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:47 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD" returned: 0 in 1.062s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:47 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] d141ddda-9299-4258-ae60-b1ee27bb6cb3 was qcow2, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:45:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:47 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:45:47 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (f78cd8e4-ee8f-4d45-b3f9-fc4ff7b8e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c5cb46-c03f-447c-a671-9c3703c9acb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c5cb46-c03f-447c-a671-9c3703c9acb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2763746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6c0a8d-b7b3-4be4-9641-2876cd735b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:52Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b93e0-67e1-4393-afa3-e91583557694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14b93e0-67e1-4393-afa3-e91583557694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d59af-7412-4159-88d9-47951741f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d59af-7412-4159-88d9-47951741f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6c0a8d-b7b3-4be4-9641-2876cd735b4e', 'volume_name': 'volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c0f4d3-9824-4cea-a294-339d6f5af89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c0f4d3-9824-4cea-a294-339d6f5af89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb1a622-6043-48bd-9f57-dacbab0afa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:52 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume ff6c0a8d-b7b3-4be4-9641-2876cd735b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e', 'volume_size': 1} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:52 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 0 in 4.983s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d141ddda-9299-4258-ae60-b1ee27bb6cb3_4kd0906qdevstack@QuobyteHD, size 112.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:45:52 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Converted 112.00 MB image at 22.47 MB/s Jul 08 19:45:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:52 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 1G Jul 08 19:45:52 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:53 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img" returned: 0 in 6.602s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba60820-4787-45d8-8f16-7ef3decf5a50]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:53 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:45:53 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:53 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 1G" returned: 0 in 1.089s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[717767b1-0317-4c29-a8a2-dcfa8c4c9fee]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:54 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:45:54 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:54 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 1.018s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:45:54 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Converted 1024.00 MB image at 155.08 MB/s Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] f1eed4cd-7c9a-471b-8efb-63b0fa8827ae was raw, converting to qcow2 {{(pid=87172) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca67c09-2df0-4a7b-baa1-eb39a388aa97]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Flow 'volume_create_manager' (207b69dc-3e7c-4226-a3ac-0ec25965ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b79da9e-e660-4d61-bc55-79e16d20c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b79da9e-e660-4d61-bc55-79e16d20c29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1302503704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51ee046-d240-4263-8d4d-9d2d95757cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8d207f4d3e40b1a31659d0846ae15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=737f3559-3ead-4e12-916f-1a6dc382dbbe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:55Z,use_quota=True,user_id='73217613871941b684daf155190e7189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867687ff-d6e2-4bda-83bd-863930a6ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:54 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img Jul 08 19:45:54 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867687ff-d6e2-4bda-83bd-863930a6ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8027e9c-df8e-41fc-a0a8-9ef4cb390b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:54 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8027e9c-df8e-41fc-a0a8-9ef4cb390b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c51ee046-d240-4263-8d4d-9d2d95757cb9', 'volume_name': 'volume-c51ee046-d240-4263-8d4d-9d2d95757cb9', 'volume_size': 1, 'snapshot_id': '737f3559-3ead-4e12-916f-1a6dc382dbbe'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e308560a-1fec-46ff-a3ae-bc6c849a23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e308560a-1fec-46ff-a3ae-bc6c849a23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbac003-b1bb-40d3-bf93-ec50fd31959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:54 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Volume c51ee046-d240-4263-8d4d-9d2d95757cb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c51ee046-d240-4263-8d4d-9d2d95757cb9', 'volume_size': 1, 'snapshot_id': '737f3559-3ead-4e12-916f-1a6dc382dbbe'} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 0 in 0.810s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:54 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:45:54 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:55 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img" returned: 0 in 0.821s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:55 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img Jul 08 19:45:55 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:55 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 1 in 0.872s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Downloaded image d141ddda-9299-4258-ae60-b1ee27bb6cb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3', 'metadata': {}}])) to volume 5365ad86-6bab-4e88-84a9-0a4ac2092142 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Temporary image d141ddda-9299-4258-ae60-b1ee27bb6cb3 for user 6c9d1d0916fa4eeeb4a3a1e386bfc6dc is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Marking volume 5365ad86-6bab-4e88-84a9-0a4ac2092142 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Copying metadata from image d141ddda-9299-4258-ae60-b1ee27bb6cb3 to 5365ad86-6bab-4e88-84a9-0a4ac2092142. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Creating volume glance metadata for volume 5365ad86-6bab-4e88-84a9-0a4ac2092142 backed by image d141ddda-9299-4258-ae60-b1ee27bb6cb3 with: {'image_id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'image_name': 'tempest-scenario-img--1543831539', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc51e0a-b9a8-4f4b-bfb9-019c1d9cb0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5365ad86-6bab-4e88-84a9-0a4ac2092142', 'volume_size': 1, 'image_id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1543831539', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c2e999f06664a95a03886e2475b8e01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd141ddda-9299-4258-ae60-b1ee27bb6cb3', 'created_at': datetime.datetime(2026, 7, 8, 17, 45, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 45, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d141ddda-9299-4258-ae60-b1ee27bb6cb3/file', 'properties': {}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e0b079-4207-43ed-91c9-a2cc0f0fb23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:45:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Volume volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 (5365ad86-6bab-4e88-84a9-0a4ac2092142): created successfully Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e0b079-4207-43ed-91c9-a2cc0f0fb23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:45:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Flow 'volume_create_manager' (df586a88-3d35-4b9c-8449-d81ffadbb182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:45:55 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0416cbab-f62f-45e6-a0c4-d55e6425d150 tempest-TestInstancesWithCinderVolumes-1562878143 None] Created volume successfully. Jul 08 19:45:56 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img" returned: 1 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:56 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8 Jul 08 19:45:56 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:56 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8" returned: 0 in 0.714s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Image conversion details: src /opt/stack/data/cinder/conversion/4fd704b2-cee7-4932-8ca3-0bd1ffa51afa.temp_image.f1eed4cd-7c9a-471b-8efb-63b0fa8827aetfseqpxc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:45:56 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e41e2bf-8e21-40f2-b267-6f788dc86d92]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:45:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:57 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8 Jul 08 19:45:57 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:57 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h3bgnyh8" returned: 0 in 0.812s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.255s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Uploaded volume to glance image-id: f1eed4cd-7c9a-471b-8efb-63b0fa8827ae. {{(pid=87172) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.794s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2763746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6c0a8d-b7b3-4be4-9641-2876cd735b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:45:52Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Creating volume ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:45:59 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:59 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e 1073741824 Jul 08 19:45:59 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:45:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d74bcb67-b24e-4f6a-bcfc-598955ab8e9a tempest-VolumesActionsTest-1954504672 None] Copy volume to image completed successfully. Jul 08 19:45:59 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e 1073741824" returned: 0 in 0.877s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:45:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:45:59 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e Jul 08 19:45:59 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Acquiring lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Acquiring lock "cinder-quobyte-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Lock "cinder-quobyte-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" acquired by "delete_volume" :: waited 0.054s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[09908f7f-aed9-4590-a65d-0528de61e5bb]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:00 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:46:00 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:00 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" returned: 0 in 0.740s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.921s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-quobyte-737f3559-3ead-4e12-916f-1a6dc382dbbe-c51ee046-d240-4263-8d4d-9d2d95757cb9" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-737f3559-3ead-4e12-916f-1a6dc382dbbe-c51ee046-d240-4263-8d4d-9d2d95757cb9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Creating volume c51ee046-d240-4263-8d4d-9d2d95757cb9 from snapshot 737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-quobyte-c51ee046-d240-4263-8d4d-9d2d95757cb9" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb1a622-6043-48bd-9f57-dacbab0afa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47f9e5a-3c87-4074-9772-bd4f57b5a866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-c51ee046-d240-4263-8d4d-9d2d95757cb9" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] snapshot: 737f3559-3ead-4e12-916f-1a6dc382dbbe, volume: c51ee046-d240-4263-8d4d-9d2d95757cb9, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e (ff6c0a8d-b7b3-4be4-9641-2876cd735b4e): created successfully Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47f9e5a-3c87-4074-9772-bd4f57b5a866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (f78cd8e4-ee8f-4d45-b3f9-fc4ff7b8e968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d2d5d-8ccc-42a4-b4bd-13279ca94ab5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d1ce1518-13ca-459f-9441-ad42bec888fc tempest-VolumesSnapshotTestJSON-1264658590 None] Created volume successfully. Jul 08 19:46:00 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe Jul 08 19:46:00 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:01 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 1.011s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:01 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa Jul 08 19:46:01 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:02 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe" returned: 0 in 1.190s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af8ff574-af10-40a3-aa00-ace2ce540ace(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b919cc-32df-4f89-b223-7a6e6f0cdb9d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:02 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:46:02 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:02 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" returned: 0 in 0.901s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Lock "cinder-quobyte-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa" released by "delete_volume" :: held 1.984s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Created reservations ['b60f21bc-ca64-41d2-96a8-78b7dffa7f30', 'ad922d9e-88ff-48a7-99ef-f27c7b30df7d', 'b6d0cb84-a121-483b-a857-655bf52342d4', 'ca98f9d1-a366-451e-820c-b9d1d28f869b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:02 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:46:02 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:03 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 1.323s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:03 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:46:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:03 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.021s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:03 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:46:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Deleted volume successfully. Jul 08 19:46:03 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 Jul 08 19:46:03 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8dffe40b-f3fa-4cfb-bb84-d19e66e06f15 tempest-VolumesActionsTest-1954504672 None] Lock "cinder-4fd704b2-cee7-4932-8ca3-0bd1ffa51afa-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:10 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9" returned: 0 in 6.714s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd384682-4936-42c4-b73d-47cac172f205]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:10 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:46:10 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:11 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 1.074s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:11 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:46:11 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Converted 1024.00 MB image at 152.49 MB/s Jul 08 19:46:11 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 is being set with open permissions: ugo+rw Jul 08 19:46:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:11 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 Jul 08 19:46:11 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:12 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9" returned: 0 in 0.882s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-c51ee046-d240-4263-8d4d-9d2d95757cb9" released by "_copy_volume_from_snapshot" :: held 11.346s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-737f3559-3ead-4e12-916f-1a6dc382dbbe-c51ee046-d240-4263-8d4d-9d2d95757cb9" released by "_create_volume_from_snapshot" :: held 11.405s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.429s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.170s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Creating offline snapshot 5fde34fb-9f67-4ab4-9237-191c5f08771b of volume ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbac003-b1bb-40d3-bf93-ec50fd31959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51ee046-d240-4263-8d4d-9d2d95757cb9', 'volume_size': 1, 'snapshot_id': '737f3559-3ead-4e12-916f-1a6dc382dbbe'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6461455b-978e-4a94-b62b-6f5b6a7448cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf1151-c8e7-4c80-8fb3-13ff574048a1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:12 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Volume volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 (c51ee046-d240-4263-8d4d-9d2d95757cb9): created successfully Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6461455b-978e-4a94-b62b-6f5b6a7448cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Flow 'volume_create_manager' (207b69dc-3e7c-4226-a3ac-0ec25965ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5121c973-a3de-4f5e-8b77-3402f0bb65b0 tempest-TestStampPattern-1987150457 None] Created volume successfully. Jul 08 19:46:12 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e Jul 08 19:46:12 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:13 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" returned: 0 in 0.965s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:13 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b 1G Jul 08 19:46:13 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Flow 'volume_create_manager' (5a86023a-9570-4103-a1c0-08809aa23379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e07021-6c2a-45e5-ad5f-003f7fe6f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e07021-6c2a-45e5-ad5f-003f7fe6f715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1512996088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a623006f-70ce-412c-b52b-af932c49d718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a347f192fb844e1878dfc46c37af984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:14Z,use_quota=True,user_id='1514bfd9e4974a2d90a104533a4b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4e7fdf-b82b-44e4-9186-9784aac9b305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4e7fdf-b82b-44e4-9186-9784aac9b305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9814557d-b40c-46ea-a63c-381c04701dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:46:14 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b 1G" returned: 0 in 1.127s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:14 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b Jul 08 19:46:14 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9814557d-b40c-46ea-a63c-381c04701dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a623006f-70ce-412c-b52b-af932c49d718', 'volume_name': 'volume-a623006f-70ce-412c-b52b-af932c49d718', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd36ee-a655-4c8f-994e-391190704367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acd36ee-a655-4c8f-994e-391190704367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f81b40-504f-409e-b9b3-a5c82cbb8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:14 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Volume a623006f-70ce-412c-b52b-af932c49d718: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a623006f-70ce-412c-b52b-af932c49d718', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 19:46:14 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Trying to clone a623006f-70ce-412c-b52b-af932c49d718 from image 35933816-a0eb-45ed-8ba6-853bccb9e496 at location (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:46:15 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:46:15 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Image download 20.69 MB at 20.69 MB/s Jul 08 19:46:15 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b538127-d136-4399-8f6e-1aec802b7913]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b" returned: 0 in 0.978s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:15 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b is being set with open permissions: ugo+rw Jul 08 19:46:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:15 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b Jul 08 19:46:15 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:15 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD Jul 08 19:46:15 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:16 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b" returned: 0 in 0.895s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:16 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info Jul 08 19:46:16 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:16 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD" returned: 0 in 1.143s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:16 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 is fetched for user 1514bfd9e4974a2d90a104533a4b024e. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:46:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95fde6f-3c66-43d5-94a9-a1e7afa4c852]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:16 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD Jul 08 19:46:16 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:17 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info" returned: 0 in 0.974s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:17 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info is being set with open permissions: ugo+rw Jul 08 19:46:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:17 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info Jul 08 19:46:17 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:17 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD" returned: 0 in 1.201s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:18 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.info" returned: 0 in 1.011s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.124s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.630s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efb923b-957c-46e3-b724-e795b5e73d6a]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9920b6d0-e702-411c-bce5-2136b5f30c8e tempest-VolumesSnapshotTestJSON-1264658590 None] Create snapshot completed successfully Jul 08 19:46:18 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:46:18 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:19 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 0 in 0.816s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:19 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:46:19 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-5fde34fb-9f67-4ab4-9237-191c5f08771b-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-5fde34fb-9f67-4ab4-9237-191c5f08771b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-5fde34fb-9f67-4ab4-9237-191c5f08771b" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-5fde34fb-9f67-4ab4-9237-191c5f08771b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleting offline snapshot 5fde34fb-9f67-4ab4-9237-191c5f08771b of volume ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] snapshot_file for this snap is: volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b7d3b-b181-481f-bc3e-b3886591db5c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:19 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b Jul 08 19:46:19 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:20 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 1 in 0.909s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.784s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.288s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1512996088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a623006f-70ce-412c-b52b-af932c49d718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a347f192fb844e1878dfc46c37af984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:14Z,use_quota=True,user_id='1514bfd9e4974a2d90a104533a4b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Creating volume a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:46:20 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:20 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 1073741824 Jul 08 19:46:20 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-5365ad86-6bab-4e88-84a9-0a4ac2092142', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d1b9ce4-d87a-4927-b381-4a5a2c1b1575', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:46:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-e081d8fe-689d-49c6-a25d-2c9e68a8b188 req-91319faf-bd4f-4fb3-826c-c7f3ec357997 tempest-TestInstancesWithCinderVolumes-1562878143 None] attachment_update completed successfully. Jul 08 19:46:20 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b" returned: 0 in 0.981s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5698a7ba-7a30-457a-a088-08734e9a0f00]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:20 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e Jul 08 19:46:20 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:21 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 1073741824" returned: 0 in 0.968s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=35,cinder:SELECT=50,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=48,cinder:UPDATE=41,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:21 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:21 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:21 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" returned: 0 in 0.865s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:21 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b Jul 08 19:46:21 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:21 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 0 in 0.895s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:46:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Attempting download of 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume a623006f-70ce-412c-b52b-af932c49d718. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[11763f49-4d70-4715-b973-817479fa2549]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:22 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x Jul 08 19:46:22 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:22 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b" returned: 0 in 0.846s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:22 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b Jul 08 19:46:22 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:22 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x" returned: 0 in 0.809s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:23 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x Jul 08 19:46:23 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:23 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e.5fde34fb-9f67-4ab4-9237-191c5f08771b" returned: 0 in 0.845s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-5fde34fb-9f67-4ab4-9237-191c5f08771b" released by "_delete_snapshot" :: held 3.672s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" released by "delete_snapshot" :: held 3.707s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['0b8ab78a-5cf4-463b-8905-4e283b7d2bed', '08a4ecdd-3eda-4fab-b25f-66d96c1fa90c', '71e55e3e-1c1f-4616-b293-2cb851803240', 'e148bd20-b8d6-4ac4-ac5e-662bf4c16dde'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:46:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Delete snapshot completed successfully. Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9792cb96-27c8-4940-9485-53c28d3a0c18 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-5fde34fb-9f67-4ab4-9237-191c5f08771b-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:23 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x" returned: 1 in 0.803s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35933816-a0eb-45ed-8ba6-853bccb9e496_clwm6t0x' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e0b03e-5c89-478a-b855-3859b8dff997]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:23 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD Jul 08 19:46:23 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:24 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:46:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (d39d9b0e-4ba8-4acf-9ad0-332d79ce5d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f3af12-8ff8-4d13-a351-b2efa619c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f3af12-8ff8-4d13-a351-b2efa619c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-585235926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a6f90c-7ccc-4cec-a95e-59de282a6892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:25Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a582faa5-5758-49d0-9f36-a108a52b513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a582faa5-5758-49d0-9f36-a108a52b513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd9e933-1df7-4c88-8251-e2621e23eef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd9e933-1df7-4c88-8251-e2621e23eef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a6f90c-7ccc-4cec-a95e-59de282a6892', 'volume_name': 'volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a1b852-d5a6-4b23-bb50-cdc75ccca2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a1b852-d5a6-4b23-bb50-cdc75ccca2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5501e37a-6b2a-4a27-a72a-f3150ccd4065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:25 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Volume a1a6f90c-7ccc-4cec-a95e-59de282a6892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892', 'volume_size': 1} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-585235926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a6f90c-7ccc-4cec-a95e-59de282a6892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:25Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Creating volume a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:46:25 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:25 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 1073741824 Jul 08 19:46:25 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:25 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD" returned: 0 in 1.734s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] 35933816-a0eb-45ed-8ba6-853bccb9e496 was qcow2, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:46:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:25 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:25 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:26 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 1073741824" returned: 0 in 1.191s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:26 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:26 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:27 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 0.756s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5501e37a-6b2a-4a27-a72a-f3150ccd4065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516d4fc9-d9d9-484e-8eee-9e2dab51f76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Volume volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 (a1a6f90c-7ccc-4cec-a95e-59de282a6892): created successfully Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516d4fc9-d9d9-484e-8eee-9e2dab51f76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (d39d9b0e-4ba8-4acf-9ad0-332d79ce5d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8b48510a-4432-409e-bfa3-3028a57e9d9c tempest-VolumesSnapshotTestJSON-1264658590 None] Created volume successfully. Jul 08 19:46:27 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 0 in 2.533s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35933816-a0eb-45ed-8ba6-853bccb9e496_ys6sm5p7devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:46:27 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Converted 112.00 MB image at 44.20 MB/s Jul 08 19:46:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:28 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 1G Jul 08 19:46:28 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Creating offline snapshot 46fd3441-1e1b-45bb-970a-de60e32b8baf of volume a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d6564d-4b80-437b-886b-8ff91433d513]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:28 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:28 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:28 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 1G" returned: 0 in 0.803s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1884e7-b7cf-4d73-821c-d32ad1d08340]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:29 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:29 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:29 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 1.146s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:29 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf 1G Jul 08 19:46:29 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:30 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 0 in 1.177s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:30 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:30 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:30 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf 1G" returned: 0 in 1.106s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:30 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf Jul 08 19:46:30 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:31 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 1 in 1.156s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Downloaded image 35933816-a0eb-45ed-8ba6-853bccb9e496 ((None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}])) to volume a623006f-70ce-412c-b52b-af932c49d718 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Temporary image 35933816-a0eb-45ed-8ba6-853bccb9e496 for user 1514bfd9e4974a2d90a104533a4b024e is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Marking volume a623006f-70ce-412c-b52b-af932c49d718 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Copying metadata from image 35933816-a0eb-45ed-8ba6-853bccb9e496 to a623006f-70ce-412c-b52b-af932c49d718. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Creating volume glance metadata for volume a623006f-70ce-412c-b52b-af932c49d718 backed by image 35933816-a0eb-45ed-8ba6-853bccb9e496 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f81b40-504f-409e-b9b3-a5c82cbb8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a623006f-70ce-412c-b52b-af932c49d718', 'volume_size': 1, 'image_id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35933816-a0eb-45ed-8ba6-853bccb9e496', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a460366ed16429d85287be2b6367f69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35933816-a0eb-45ed-8ba6-853bccb9e496', 'created_at': datetime.datetime(2026, 7, 8, 17, 25, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 25, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35933816-a0eb-45ed-8ba6-853bccb9e496/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7901e6-a576-4aec-818b-4bc65706857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Volume volume-a623006f-70ce-412c-b52b-af932c49d718 (a623006f-70ce-412c-b52b-af932c49d718): created successfully Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7901e6-a576-4aec-818b-4bc65706857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Flow 'volume_create_manager' (5a86023a-9570-4103-a1c0-08809aa23379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:31 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c1db42a7-510d-4731-a1b1-96d50409b887 tempest-VolumesExtendTest-1762478131 None] Created volume successfully. Jul 08 19:46:31 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf" returned: 0 in 1.148s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:31 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf is being set with open permissions: ugo+rw Jul 08 19:46:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:31 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf Jul 08 19:46:31 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:32 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf" returned: 0 in 1.106s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:33 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info Jul 08 19:46:33 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:33 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info" returned: 0 in 0.814s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:33 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info is being set with open permissions: ugo+rw Jul 08 19:46:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:33 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info Jul 08 19:46:33 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:34 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.info" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.177s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.431s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dac0e438-ada5-4e2e-a392-bb1d893e6f0b tempest-VolumesSnapshotTestJSON-1264658590 None] Create snapshot completed successfully Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[74375503-e43b-4074-a17f-7292aee4bcf1]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:46:34 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:34 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:34 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:46:34 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:35 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 0 in 1.151s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (13ea2638-872b-4503-8b97-69846a441300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ddcd38-a401-4a03-b7a7-e1c8b8361960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ddcd38-a401-4a03-b7a7-e1c8b8361960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-176783367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df4400c-6fc9-44f5-bdbe-51c50d703c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=46fd3441-1e1b-45bb-970a-de60e32b8baf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:36Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cd754a-2908-4d81-b354-d1c7fdff56fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:35 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:35 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cd754a-2908-4d81-b354-d1c7fdff56fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ab6392-7bcc-4abf-b7b6-8ca2b3106aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ab6392-7bcc-4abf-b7b6-8ca2b3106aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0df4400c-6fc9-44f5-bdbe-51c50d703c51', 'volume_name': 'volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51', 'volume_size': 2, 'snapshot_id': '46fd3441-1e1b-45bb-970a-de60e32b8baf'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07bfc43-1211-4ab3-9698-de47402f9469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07bfc43-1211-4ab3-9698-de47402f9469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a90a05-2684-4d5e-8a5e-10a82bc9880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:35 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Volume 0df4400c-6fc9-44f5-bdbe-51c50d703c51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51', 'volume_size': 2, 'snapshot_id': '46fd3441-1e1b-45bb-970a-de60e32b8baf'} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:35 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.244s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:46:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:46:36 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 1 in 0.869s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 2G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 2G" returned: 0 in 0.077s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.151s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.736s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-46fd3441-1e1b-45bb-970a-de60e32b8baf-0df4400c-6fc9-44f5-bdbe-51c50d703c51" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-46fd3441-1e1b-45bb-970a-de60e32b8baf-0df4400c-6fc9-44f5-bdbe-51c50d703c51" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Creating volume 0df4400c-6fc9-44f5-bdbe-51c50d703c51 from snapshot 46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-0df4400c-6fc9-44f5-bdbe-51c50d703c51" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-0df4400c-6fc9-44f5-bdbe-51c50d703c51" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] snapshot: 46fd3441-1e1b-45bb-970a-de60e32b8baf, volume: 0df4400c-6fc9-44f5-bdbe-51c50d703c51, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f301f3e2-4059-4e85-864e-a37bb9595cca tempest-VolumesExtendTest-1762478131 None] Extend volume completed successfully. Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ef7fe-2ecb-49f6-a43c-25d2188ffed2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:36 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf Jul 08 19:46:36 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:37 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf" returned: 0 in 0.812s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f06504-5a9a-4909-8227-7e10a78488ab]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:37 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:37 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-a623006f-70ce-412c-b52b-af932c49d718-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-a623006f-70ce-412c-b52b-af932c49d718-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-quobyte-a623006f-70ce-412c-b52b-af932c49d718" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-a623006f-70ce-412c-b52b-af932c49d718" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[156fb010-c553-48c1-9e14-0ca3f7d10389]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:38 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:38 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:38 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 0.894s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:38 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 Jul 08 19:46:38 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:38 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 0 in 0.953s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:39 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:39 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:40 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 1 in 1.863s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:46:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:40 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718 Jul 08 19:46:40 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:42 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a623006f-70ce-412c-b52b-af932c49d718" returned: 0 in 2.010s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-a623006f-70ce-412c-b52b-af932c49d718" released by "delete_volume" :: held 4.917s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Created reservations ['c4dff9ad-5008-42a1-baf7-f191f4453a10', '5db9f3ed-f6b6-4cab-979c-14f32f4e11cf', '3cc419d0-602f-4e88-a127-eb5b5730908c', 'fc79023d-435d-40ff-a904-2446729c19ff'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:43 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:46:43 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:44 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.579s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:44 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:46:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Deleted volume successfully. Jul 08 19:46:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a949025e-b303-4a78-85d7-012797c9eff6 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-a623006f-70ce-412c-b52b-af932c49d718-delete_volume" released by "delete_volume" :: held 6.982s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:44 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51" returned: 0 in 6.432s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[56491a91-193b-4061-be87-155048da4fdb]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:45 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:45 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Flow 'volume_create_manager' (883c44ce-2a25-4280-b34c-339c7ea4ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1668385-5cd5-407f-8ece-d51a937accea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1668385-5cd5-407f-8ece-d51a937accea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1356253534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a347f192fb844e1878dfc46c37af984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:45Z,use_quota=True,user_id='1514bfd9e4974a2d90a104533a4b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5f757f-d8b9-4614-9dce-f15e6a09aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5f757f-d8b9-4614-9dce-f15e6a09aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78242e-489d-446b-8493-e7fac8128b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc78242e-489d-446b-8493-e7fac8128b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee', 'volume_name': 'volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6db545-5715-49bc-b172-9871ecef9c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6db545-5715-49bc-b172-9871ecef9c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407cc69c-4c78-42c6-b8d5-bfb07acc7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Volume 96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee', 'volume_size': 1} Jul 08 19:46:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:46 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 1.037s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:46:46 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Converted 1024.00 MB image at 159.18 MB/s Jul 08 19:46:46 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 is being set with open permissions: ugo+rw Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:46 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 Jul 08 19:46:46 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:46 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51" returned: 0 in 0.634s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-0df4400c-6fc9-44f5-bdbe-51c50d703c51" released by "_copy_volume_from_snapshot" :: held 9.927s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-46fd3441-1e1b-45bb-970a-de60e32b8baf-0df4400c-6fc9-44f5-bdbe-51c50d703c51" released by "_create_volume_from_snapshot" :: held 9.967s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.997s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1356253534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a347f192fb844e1878dfc46c37af984',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:45Z,use_quota=True,user_id='1514bfd9e4974a2d90a104533a4b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Creating volume 96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:46:46 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:46 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee 1073741824 Jul 08 19:46:46 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a90a05-2684-4d5e-8a5e-10a82bc9880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51', 'volume_size': 2, 'snapshot_id': '46fd3441-1e1b-45bb-970a-de60e32b8baf'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef18bf0-5871-42c2-aa98-6f5eb10116f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Volume volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 (0df4400c-6fc9-44f5-bdbe-51c50d703c51): created successfully Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef18bf0-5871-42c2-aa98-6f5eb10116f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (13ea2638-872b-4503-8b97-69846a441300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c272219d-87b3-4641-8753-f5d1af39d1b9 tempest-VolumesSnapshotTestJSON-1264658590 None] Created volume successfully. Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-0df4400c-6fc9-44f5-bdbe-51c50d703c51-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-0df4400c-6fc9-44f5-bdbe-51c50d703c51-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-0df4400c-6fc9-44f5-bdbe-51c50d703c51" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-0df4400c-6fc9-44f5-bdbe-51c50d703c51" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d7d234-2c09-4249-893d-f8e913287c68]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:47 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 Jul 08 19:46:47 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:47 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee 1073741824" returned: 0 in 0.819s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:47 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee Jul 08 19:46:47 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:47 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51" returned: 0 in 0.762s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:48 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51 Jul 08 19:46:48 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:48 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" returned: 0 in 0.670s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407cc69c-4c78-42c6-b8d5-bfb07acc7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf81b0f8-7db4-4892-a4f9-f50c8b4fe914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Volume volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee (96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee): created successfully Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf81b0f8-7db4-4892-a4f9-f50c8b4fe914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Flow 'volume_create_manager' (883c44ce-2a25-4280-b34c-339c7ea4ff65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f4774f59-4a87-4797-90ed-b152c86a1cc8 tempest-VolumesExtendTest-1762478131 None] Created volume successfully. Jul 08 19:46:48 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0df4400c-6fc9-44f5-bdbe-51c50d703c51" returned: 0 in 0.650s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-0df4400c-6fc9-44f5-bdbe-51c50d703c51" released by "delete_volume" :: held 1.461s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['927a9e97-31f3-45c0-9a0c-17a11cb49645', '78fec8c5-fb10-42b6-9091-7aba0fcfbdea', 'b4fed9e9-3f05-49ec-93a5-1d54ba79ce29', 'a8394326-0502-47ff-a8c3-d63cf8760f8a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:48 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:46:48 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:49 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-46fd3441-1e1b-45bb-970a-de60e32b8baf-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.672s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:46:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleted volume successfully. Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-46fd3441-1e1b-45bb-970a-de60e32b8baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-a1a6f90c-7ccc-4cec-a95e-59de282a6892" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24825a6e-3f65-4ae0-9787-552892d80004 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-0df4400c-6fc9-44f5-bdbe-51c50d703c51-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-a1a6f90c-7ccc-4cec-a95e-59de282a6892" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-46fd3441-1e1b-45bb-970a-de60e32b8baf" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-46fd3441-1e1b-45bb-970a-de60e32b8baf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleting offline snapshot 46fd3441-1e1b-45bb-970a-de60e32b8baf of volume a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] snapshot_file for this snap is: volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dda5af-55d2-4154-8beb-a67218495cf3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Creating offline snapshot ab2ec1b2-1766-45b2-b687-9b0a628059dc of volume 96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dbe83e-802e-4396-a687-a50cb16dc767]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:49 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf Jul 08 19:46:49 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:49 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee Jul 08 19:46:49 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:50 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:46:50 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c09a4-c47d-4f7a-8ee2-4be9f737573c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:50 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:50 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc 1G Jul 08 19:46:50 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:50 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:50 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:51 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 0.771s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:51 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf Jul 08 19:46:51 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:51 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc 1G" returned: 0 in 0.810s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:51 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc Jul 08 19:46:51 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:51 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf" returned: 0 in 0.715s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:51 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf Jul 08 19:46:51 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:51 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:51 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc is being set with open permissions: ugo+rw Jul 08 19:46:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:52 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc Jul 08 19:46:52 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:52 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892.46fd3441-1e1b-45bb-970a-de60e32b8baf" returned: 0 in 0.694s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-46fd3441-1e1b-45bb-970a-de60e32b8baf" released by "_delete_snapshot" :: held 3.091s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-a1a6f90c-7ccc-4cec-a95e-59de282a6892" released by "delete_snapshot" :: held 3.115s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:52 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc" returned: 0 in 0.680s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['a9588a2a-7304-4287-b975-9630b905ee67', '1b101b02-ad24-4900-8737-ffba56ee30a2', '9c01f06b-026f-404c-8ce7-8ff71eb72d88', '42a697bc-86a1-40ac-be0b-9efed41dc86b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:52 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info Jul 08 19:46:52 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:52 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Delete snapshot completed successfully. Jul 08 19:46:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9928d9fb-1505-4ec0-89ba-19377f98e175 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-46fd3441-1e1b-45bb-970a-de60e32b8baf-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:53 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info" returned: 0 in 0.666s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:53 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info is being set with open permissions: ugo+rw Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:53 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info Jul 08 19:46:53 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-a1a6f90c-7ccc-4cec-a95e-59de282a6892-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-a1a6f90c-7ccc-4cec-a95e-59de282a6892-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-a1a6f90c-7ccc-4cec-a95e-59de282a6892" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-a1a6f90c-7ccc-4cec-a95e-59de282a6892" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ad3970-1d14-4a5d-bfb1-d76b921aacd5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:54 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:54 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:54 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.info" returned: 0 in 0.724s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-317c5baf-6ec2-4fb9-874e-24a31bca910c tempest-VolumesExtendTest-1762478131 None] Create snapshot completed successfully Jul 08 19:46:54 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 0.810s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:54 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892 Jul 08 19:46:54 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[52813bb1-50a6-4ea0-bd02-7904879e14bc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:55 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee Jul 08 19:46:55 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:55 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1a6f90c-7ccc-4cec-a95e-59de282a6892" returned: 0 in 0.749s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-a1a6f90c-7ccc-4cec-a95e-59de282a6892" released by "delete_volume" :: held 1.658s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['cb67fe73-8356-4915-8db0-0ae25d577c5c', '62082075-dc94-4335-8810-b523dd6faeb9', '5436655e-71e6-4a23-a99d-3bbc55079b14', '54c41ecc-155c-4d15-8a9f-7f19a5651f6f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:55 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:46:55 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:55 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" returned: 0 in 0.893s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc 2G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc 2G" returned: 0 in 0.184s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.127s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:56 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f6b55e31-d8e2-450c-b32f-371cf1ca7193 tempest-VolumesExtendTest-1762478131 None] Extend volume completed successfully. Jul 08 19:46:56 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.768s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:46:56 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleted volume successfully. Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2ef9c7c4-6e79-49f8-b2a2-66cf73d7f337 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-a1a6f90c-7ccc-4cec-a95e-59de282a6892-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (099e0380-5d1e-4dfe-b716-7862c9e91e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30827039-fae8-4092-b3b5-ca5fa51b722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30827039-fae8-4092-b3b5-ca5fa51b722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2046540275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb24a42f-2969-4b53-b14c-b37741ae8afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:57Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a04762-31ff-4024-8374-3ba1e949d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a04762-31ff-4024-8374-3ba1e949d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a1596b-e3db-4ae3-80f1-c938670b2974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a1596b-e3db-4ae3-80f1-c938670b2974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb24a42f-2969-4b53-b14c-b37741ae8afc', 'volume_name': 'volume-eb24a42f-2969-4b53-b14c-b37741ae8afc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5d1d12-3c82-4742-8599-980958423d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5d1d12-3c82-4742-8599-980958423d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f520a4-b90d-4e05-b705-531169918299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:56 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume eb24a42f-2969-4b53-b14c-b37741ae8afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb24a42f-2969-4b53-b14c-b37741ae8afc', 'volume_size': 1} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2046540275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb24a42f-2969-4b53-b14c-b37741ae8afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:46:57Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Creating volume eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:46:56 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:46:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:56 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc 1073741824 Jul 08 19:46:56 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-ab2ec1b2-1766-45b2-b687-9b0a628059dc-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Lock "cinder-ab2ec1b2-1766-45b2-b687-9b0a628059dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-quobyte-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-quobyte-ab2ec1b2-1766-45b2-b687-9b0a628059dc" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-ab2ec1b2-1766-45b2-b687-9b0a628059dc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Deleting offline snapshot ab2ec1b2-1766-45b2-b687-9b0a628059dc of volume 96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] snapshot_file for this snap is: volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c2ce16-7ef1-4f6c-9d01-cf844f850037]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:57 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc Jul 08 19:46:57 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:57 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc 1073741824" returned: 0 in 0.923s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:57 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:46:57 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:58 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc" returned: 0 in 0.804s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34cb5c3-6a4b-4ce8-97f5-f09393e76465]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:58 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee Jul 08 19:46:58 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:58 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 0.688s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.145s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f520a4-b90d-4e05-b705-531169918299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb24a42f-2969-4b53-b14c-b37741ae8afc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb91c878-1572-4b33-8244-e8860fbbb8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8273923f-651b-4877-8574-14304994747d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume volume-eb24a42f-2969-4b53-b14c-b37741ae8afc (eb24a42f-2969-4b53-b14c-b37741ae8afc): created successfully Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb91c878-1572-4b33-8244-e8860fbbb8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:46:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (099e0380-5d1e-4dfe-b716-7862c9e91e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:46:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f7fabded-c3c4-444c-9a25-75680409d5dc tempest-VolumesSnapshotTestJSON-1264658590 None] Created volume successfully. Jul 08 19:46:58 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 Jul 08 19:46:58 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:59 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" returned: 0 in 0.846s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:59 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc Jul 08 19:46:59 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:59 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9" returned: 0 in 0.890s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.178s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Creating offline snapshot 42bdb96f-3194-4558-99af-c0affd7c25c9 of volume eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e2d10-7abb-465d-9446-7dfe1349e6a5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-c51ee046-d240-4263-8d4d-9d2d95757cb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59a26eae-748c-4222-ba4e-ce1ffae7b6c8', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:46:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-42039435-888e-4926-a052-d84cc7758231 req-5e587751-223c-4299-8077-d8e64fd0b8fe tempest-TestStampPattern-1987150457 None] attachment_update completed successfully. Jul 08 19:46:59 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:46:59 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:46:59 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc" returned: 0 in 0.833s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:46:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:46:59 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc Jul 08 19:47:00 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:00 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 0.829s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:00 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 1G Jul 08 19:47:00 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:00 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee.ab2ec1b2-1766-45b2-b687-9b0a628059dc" returned: 0 in 0.705s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-ab2ec1b2-1766-45b2-b687-9b0a628059dc" released by "_delete_snapshot" :: held 3.311s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" released by "delete_snapshot" :: held 3.336s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Created reservations ['dede4149-c1f3-4c9f-8bd7-85a461de802e', 'c7f8bbb9-b52a-4dcf-84b7-6e0217d09410', 'f4244409-869d-43b0-8dc0-4ae3948760ca', '663d930a-8166-4657-bf06-d6a2a5698e6c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Delete snapshot completed successfully. Jul 08 19:47:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-cf03edc4-0a96-4050-b37b-c1281a9893ba tempest-VolumesExtendTest-1762478131 None] Lock "cinder-ab2ec1b2-1766-45b2-b687-9b0a628059dc-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:01 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 1G" returned: 0 in 0.895s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb24a42f-2969-4b53-b14c-b37741ae8afc -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:01 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb24a42f-2969-4b53-b14c-b37741ae8afc -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 Jul 08 19:47:01 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "cinder-quobyte-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a7f4db-87f1-487e-a850-107996740f30]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:01 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb24a42f-2969-4b53-b14c-b37741ae8afc -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9" returned: 0 in 0.732s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:01 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 is being set with open permissions: ugo+rw Jul 08 19:47:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:01 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 Jul 08 19:47:01 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:01 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee Jul 08 19:47:01 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:02 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9" returned: 0 in 0.735s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:02 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" returned: 0 in 0.804s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:02 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info Jul 08 19:47:02 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:02 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee Jul 08 19:47:02 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:03 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info" returned: 0 in 0.676s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:03 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info is being set with open permissions: ugo+rw Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:03 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info Jul 08 19:47:03 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:03 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" returned: 0 in 0.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-quobyte-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee" released by "delete_volume" :: held 1.566s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Created reservations ['70e5968a-db88-4fae-9ac5-cb08533dba49', '1e15c2f0-93c8-4119-8fd1-26ee4df77dc4', '0d292ac0-99bd-4fa2-a2d3-f9a2b8a1a17f', '4f519bfb-5600-4f89-acb9-1ff4be36f2c9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:03 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:03 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:04 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.info" returned: 0 in 0.720s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.709s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.385s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfd633-5ded-4eb3-bfb2-cdbdec5091e5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6f458263-c4c1-41cc-8fc8-2ca59e64b880 tempest-VolumesSnapshotTestJSON-1264658590 None] Create snapshot completed successfully Jul 08 19:47:04 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:04 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.752s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:04 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Deleted volume successfully. Jul 08 19:47:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1814b5c0-96c5-4700-ae93-a3b569d17ae0 tempest-VolumesExtendTest-1762478131 None] Lock "cinder-96d0e3f5-aad0-424a-8f0c-5aa5fb03b3ee-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:05 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3" returned: 0 in 0.932s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-33086738-322b-44fc-8fd6-3e97f6aca5b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6534e3b-cefc-491e-83b5-c776a9d83150', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:47:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-22247e55-85dd-41d6-bd55-fe2a34365cf7 req-6f8f98a7-7189-4813-b720-62415ccc78f5 tempest-TestInstancesWithCinderVolumes-1562878143 None] attachment_update completed successfully. Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (98d35ff6-5881-44a5-85da-51a26d8f6564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e91f895-d978-4c53-ad09-96774bb80106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e91f895-d978-4c53-ad09-96774bb80106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-924885669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed4745c-f855-4d00-8be0-fdbafd680bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e14d0eddff43838c59149fa83dcb39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42bdb96f-3194-4558-99af-c0affd7c25c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:05Z,use_quota=True,user_id='a66009262d6e4985818cbd69fd008bca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba093ef-7851-4513-afb1-91277aff6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba093ef-7851-4513-afb1-91277aff6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b8b402-6060-433e-b15f-166b93d74d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b8b402-6060-433e-b15f-166b93d74d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ed4745c-f855-4d00-8be0-fdbafd680bd1', 'volume_name': 'volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1', 'volume_size': 1, 'snapshot_id': '42bdb96f-3194-4558-99af-c0affd7c25c9'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7c279d-a1bf-4e0e-a34c-65df271c9afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7c279d-a1bf-4e0e-a34c-65df271c9afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aae7707-dab6-4967-8dd0-bc51d8bbd1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume 7ed4745c-f855-4d00-8be0-fdbafd680bd1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1', 'volume_size': 1, 'snapshot_id': '42bdb96f-3194-4558-99af-c0affd7c25c9'} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-42bdb96f-3194-4558-99af-c0affd7c25c9-7ed4745c-f855-4d00-8be0-fdbafd680bd1" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-42bdb96f-3194-4558-99af-c0affd7c25c9-7ed4745c-f855-4d00-8be0-fdbafd680bd1" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Creating volume 7ed4745c-f855-4d00-8be0-fdbafd680bd1 from snapshot 42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-7ed4745c-f855-4d00-8be0-fdbafd680bd1" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-7ed4745c-f855-4d00-8be0-fdbafd680bd1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] snapshot: 42bdb96f-3194-4558-99af-c0affd7c25c9, volume: 7ed4745c-f855-4d00-8be0-fdbafd680bd1, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[77370a50-6e2d-4446-83d3-745fd6f993ec]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:05 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 Jul 08 19:47:05 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:06 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9" returned: 0 in 0.872s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb24a42f-2969-4b53-b14c-b37741ae8afc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d01c16-309b-4696-a975-087b51dfe12a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:06 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:47:06 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-57fd0ea4-d61e-438b-8393-721293ed3c67 req-75b57ad2-cc7f-4d25-bde6-a2385c4779c5 tempest-TestStampPattern-1987150457 None] Terminate volume connection completed successfully. Jul 08 19:47:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-57fd0ea4-d61e-438b-8393-721293ed3c67 req-75b57ad2-cc7f-4d25-bde6-a2385c4779c5 tempest-TestStampPattern-1987150457 None] Deleting attachment 59a26eae-748c-4222-ba4e-ce1ffae7b6c8. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:47:07 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 0.853s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:07 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:47:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:07 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 Jul 08 19:47:07 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:13 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1" returned: 0 in 5.948s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:13 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd68ba-cbf7-44f1-b642-4627556baa53]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:13 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:47:13 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:14 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 1.384s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:14 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:47:14 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Converted 1024.00 MB image at 172.11 MB/s Jul 08 19:47:14 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 is being set with open permissions: ugo+rw Jul 08 19:47:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:14 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 Jul 08 19:47:14 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:15 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1" returned: 0 in 0.708s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-7ed4745c-f855-4d00-8be0-fdbafd680bd1" released by "_copy_volume_from_snapshot" :: held 9.919s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-42bdb96f-3194-4558-99af-c0affd7c25c9-7ed4745c-f855-4d00-8be0-fdbafd680bd1" released by "_create_volume_from_snapshot" :: held 9.967s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.990s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.341s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79b4180-9f01-4deb-8e4b-6c8e52b8dd24]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aae7707-dab6-4967-8dd0-bc51d8bbd1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1', 'volume_size': 1, 'snapshot_id': '42bdb96f-3194-4558-99af-c0affd7c25c9'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4da690-5fe0-4808-a6e5-ca8d48e6d3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Volume volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 (7ed4745c-f855-4d00-8be0-fdbafd680bd1): created successfully Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4da690-5fe0-4808-a6e5-ca8d48e6d3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Flow 'volume_create_manager' (98d35ff6-5881-44a5-85da-51a26d8f6564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b41f4353-9a28-49ca-b813-fb2403cc0adc tempest-VolumesSnapshotTestJSON-1264658590 None] Created volume successfully. Jul 08 19:47:15 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 Jul 08 19:47:15 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:16 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524" returned: 0 in 0.865s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-345e7ce0-d1de-4e0c-95b3-44e417dac524', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e46820a-c22a-4a6f-b707-2b5961f519ce', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:47:16 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-be78ec27-ab8b-4adf-92cd-430b588e1b8b req-ae1b0397-326a-469e-8779-df63c6a014fb tempest-TestInstancesWithCinderVolumes-1562878143 None] attachment_update completed successfully. Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-7ed4745c-f855-4d00-8be0-fdbafd680bd1-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-7ed4745c-f855-4d00-8be0-fdbafd680bd1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-7ed4745c-f855-4d00-8be0-fdbafd680bd1" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-7ed4745c-f855-4d00-8be0-fdbafd680bd1" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4936b2-53d8-412e-aaf4-bc284088082c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:16 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 Jul 08 19:47:16 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:17 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1" returned: 0 in 0.981s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:17 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1 Jul 08 19:47:17 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-c51ee046-d240-4263-8d4d-9d2d95757cb9-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Lock "cinder-c51ee046-d240-4263-8d4d-9d2d95757cb9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:18 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ed4745c-f855-4d00-8be0-fdbafd680bd1" returned: 0 in 0.779s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-7ed4745c-f855-4d00-8be0-fdbafd680bd1" released by "delete_volume" :: held 1.874s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-quobyte-c51ee046-d240-4263-8d4d-9d2d95757cb9" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-c51ee046-d240-4263-8d4d-9d2d95757cb9" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e165d79d-05d1-47e5-86d9-a8be63fb9db6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['2198d33c-4876-4025-b166-26939a628287', 'eddb2245-1060-403b-b986-a7a8408f0b6b', '399bb530-f751-4531-9f79-4d1584fd7c4f', '6e1d4959-91fb-4fa9-ad27-6c1524c20380'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:18 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:18 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:18 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 Jul 08 19:47:18 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-42bdb96f-3194-4558-99af-c0affd7c25c9-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-42bdb96f-3194-4558-99af-c0affd7c25c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-eb24a42f-2969-4b53-b14c-b37741ae8afc" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-eb24a42f-2969-4b53-b14c-b37741ae8afc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-42bdb96f-3194-4558-99af-c0affd7c25c9" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-42bdb96f-3194-4558-99af-c0affd7c25c9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleting offline snapshot 42bdb96f-3194-4558-99af-c0affd7c25c9 of volume eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] snapshot_file for this snap is: volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a1041-2957-4ab3-b716-339901d8b31e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:19 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 Jul 08 19:47:19 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:19 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.899s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleted volume successfully. Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-378b9cea-cac4-4f50-b859-cbb4557953a2 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-7ed4745c-f855-4d00-8be0-fdbafd680bd1-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:19 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9" returned: 0 in 1.086s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:19 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9 Jul 08 19:47:19 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:20 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9" returned: 0 in 1.096s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb24a42f-2969-4b53-b14c-b37741ae8afc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a398e83-7fdc-4838-a8f5-035301be0656]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:20 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:47:20 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:20 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c51ee046-d240-4263-8d4d-9d2d95757cb9" returned: 0 in 0.849s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-c51ee046-d240-4263-8d4d-9d2d95757cb9" released by "delete_volume" :: held 1.988s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Created reservations ['5bf1e292-c2ce-44f3-a102-ef5471047c02', 'facc3d44-6e47-4354-8409-f2df24144e06', '339c3826-4a9e-4489-a2b6-7c4c746f677b', 'c11c17ac-6947-473b-920c-a01301726531'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:20 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:20 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:21 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 1.190s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:21 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 Jul 08 19:47:21 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:21 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.929s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:21 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Deleted volume successfully. Jul 08 19:47:21 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=88,cinder:INSERT=28,cinder:UPDATE=87,cinder:DELETE=9 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:47:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-91e7ae13-adb5-44d4-aa68-2f2221a55dce tempest-TestStampPattern-1987150457 None] Lock "cinder-c51ee046-d240-4263-8d4d-9d2d95757cb9-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-737f3559-3ead-4e12-916f-1a6dc382dbbe-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Lock "cinder-737f3559-3ead-4e12-916f-1a6dc382dbbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-quobyte-af8ff574-af10-40a3-aa00-ace2ce540ace" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-af8ff574-af10-40a3-aa00-ace2ce540ace" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-quobyte-737f3559-3ead-4e12-916f-1a6dc382dbbe" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-737f3559-3ead-4e12-916f-1a6dc382dbbe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Deleting offline snapshot 737f3559-3ead-4e12-916f-1a6dc382dbbe of volume af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] snapshot_file for this snap is: volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4447e0fb-7e20-4510-b891-66a5be1f8099]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:22 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe Jul 08 19:47:22 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:22 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9" returned: 0 in 0.994s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:22 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9 Jul 08 19:47:22 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:23 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe" returned: 0 in 1.000s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af8ff574-af10-40a3-aa00-ace2ce540ace(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9f05bc-4e12-45eb-a183-c0acbe3e5ad3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:23 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc.42bdb96f-3194-4558-99af-c0affd7c25c9" returned: 0 in 0.939s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-42bdb96f-3194-4558-99af-c0affd7c25c9" released by "_delete_snapshot" :: held 4.378s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-eb24a42f-2969-4b53-b14c-b37741ae8afc" released by "delete_snapshot" :: held 4.415s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=104,cinder:SELECT=105,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:47:23 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:47:23 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['578b745f-32e7-4394-8b36-b0f79f4ac047', 'c11237c9-14a4-49a3-b5d4-be1c1feb9d7d', 'c274827f-1bb9-4e0f-b565-ef74235a897d', '04b25d7d-dae0-497b-9139-5e64a2ebc7ef'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Delete snapshot completed successfully. Jul 08 19:47:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-223e8de7-2372-484b-bc6c-c6336445af41 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-42bdb96f-3194-4558-99af-c0affd7c25c9-delete_snapshot" released by "delete_snapshot" :: held 4.607s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:24 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 0.958s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:24 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe Jul 08 19:47:24 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-eb24a42f-2969-4b53-b14c-b37741ae8afc-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-eb24a42f-2969-4b53-b14c-b37741ae8afc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-eb24a42f-2969-4b53-b14c-b37741ae8afc" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-eb24a42f-2969-4b53-b14c-b37741ae8afc" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[70941fd2-3bbb-41c2-a099-ab93c17bdf03]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:24 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:47:24 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:25 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe" returned: 0 in 0.951s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:25 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe Jul 08 19:47:25 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:25 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 0.910s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:25 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc Jul 08 19:47:25 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:26 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace.737f3559-3ead-4e12-916f-1a6dc382dbbe" returned: 0 in 0.814s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-737f3559-3ead-4e12-916f-1a6dc382dbbe" released by "_delete_snapshot" :: held 3.856s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-af8ff574-af10-40a3-aa00-ace2ce540ace" released by "delete_snapshot" :: held 3.887s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Created reservations ['b19d5422-9efb-4a7b-99e5-5dfe88d84141', 'a8c19e41-5afb-4a9a-91d7-ffc93cd850cf', '97b15e60-e52a-4b7f-b8cc-b894fb4caa25', 'dab3fff3-c86f-4e5b-b2f8-65267e67fa84'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:26 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-eb24a42f-2969-4b53-b14c-b37741ae8afc" returned: 0 in 0.706s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-eb24a42f-2969-4b53-b14c-b37741ae8afc" released by "delete_volume" :: held 1.708s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Delete snapshot completed successfully. Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-12c14627-0d10-4156-bb78-ee62901e3ecf tempest-TestStampPattern-1987150457 None] Lock "cinder-737f3559-3ead-4e12-916f-1a6dc382dbbe-delete_snapshot" released by "delete_snapshot" :: held 4.147s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['e6ac6036-691c-4fbb-b7d9-c54780b7b72b', '478b601e-071d-4d89-a564-a44215c0eeb5', '1f0d54c4-b69b-4a35-8303-b44eeea3c11f', '918bcdb7-c5f6-4566-9a17-d9fe6623da05'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:26 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:26 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-d181bc8f-d02b-47cc-8ddf-509227a25e1f req-d1fe7205-30f0-4911-a441-ec6adf99422f tempest-TestInstancesWithCinderVolumes-1562878143 None] Terminate volume connection completed successfully. Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-d181bc8f-d02b-47cc-8ddf-509227a25e1f req-d1fe7205-30f0-4911-a441-ec6adf99422f tempest-TestInstancesWithCinderVolumes-1562878143 None] Deleting attachment c6534e3b-cefc-491e-83b5-c776a9d83150. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:47:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "cinder-quobyte-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65da1fe-a3b4-42dd-a4e6-431dde968cf1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:27 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e Jul 08 19:47:27 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:27 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleted volume successfully. Jul 08 19:47:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-45543f99-0719-43dc-8148-40307d46ad21 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-eb24a42f-2969-4b53-b14c-b37741ae8afc-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:28 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" returned: 0 in 1.111s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:28 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e Jul 08 19:47:28 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "cinder-33086738-322b-44fc-8fd6-3e97f6aca5b3-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-33086738-322b-44fc-8fd6-3e97f6aca5b3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "cinder-quobyte-33086738-322b-44fc-8fd6-3e97f6aca5b3" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-quobyte-33086738-322b-44fc-8fd6-3e97f6aca5b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[61984101-95c2-4a5a-92a8-f7877e6b7368]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:29 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 Jul 08 19:47:29 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:29 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" returned: 0 in 1.019s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-quobyte-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e" released by "delete_volume" :: held 2.221s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Created reservations ['fef54966-8bba-402d-a9e2-fa2a717b0ac8', 'aff82bce-5dd3-4d34-b0d8-ab63128c55b3', 'ecbef9e5-49eb-42e4-9073-a4dda59bcd87', '6d97ed30-5132-4d11-a30a-3a9c38ee71db'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:29 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:29 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:30 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3" returned: 0 in 1.525s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:30 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3 Jul 08 19:47:30 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:30 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.138s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:30 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Deleted volume successfully. Jul 08 19:47:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c168f13a-4596-487c-84b1-ed4805f2e2a3 tempest-VolumesSnapshotTestJSON-1264658590 None] Lock "cinder-ff6c0a8d-b7b3-4be4-9641-2876cd735b4e-delete_volume" released by "delete_volume" :: held 3.791s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:31 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-33086738-322b-44fc-8fd6-3e97f6aca5b3" returned: 0 in 0.966s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-quobyte-33086738-322b-44fc-8fd6-3e97f6aca5b3" released by "delete_volume" :: held 2.545s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:31 devstack cinder-volume[87172]: WARNING cinder.quota [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1992657255-396810260 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1992657255-396810260, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:47:31 devstack cinder-volume[87172]: WARNING cinder.quota [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1992657255-396810260 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1992657255-396810260, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Created reservations ['f6984357-a43e-4e20-a0c3-98efca1a664a', '790fafe2-1653-473d-8e64-b43a9fd3b115', 'ffd36ea3-a0aa-4544-b9c1-0d1d898fdd58', 'fd938770-11b2-47d1-a78c-8a35cfe0f0c6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:31 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:31 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:32 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.842s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:32 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deleted volume successfully. Jul 08 19:47:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ad93ef5-5d5a-4864-a295-356d2148f226 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-33086738-322b-44fc-8fd6-3e97f6aca5b3-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-2e1d96f2-1c07-4c3f-b1a7-160058c15ba0 req-07e0b574-2b78-421e-be50-9a891363c08d tempest-TestInstancesWithCinderVolumes-1562878143 None] Terminate volume connection completed successfully. Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-2e1d96f2-1c07-4c3f-b1a7-160058c15ba0 req-07e0b574-2b78-421e-be50-9a891363c08d tempest-TestInstancesWithCinderVolumes-1562878143 None] Deleting attachment 9e46820a-c22a-4a6f-b707-2b5961f519ce. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:34 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:34 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Flow 'volume_create_manager' (464dc5bb-e40b-4672-8306-df699803ef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3973af05-e559-49be-a9ac-ffdc220490da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3973af05-e559-49be-a9ac-ffdc220490da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1769058454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb4dfd57afa498eb1ad2b33379538a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:35Z,use_quota=True,user_id='443d59fd6ed04aaa923cd54f6aaa78ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a838cf-d799-4e62-93d1-b471d3b4d958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a838cf-d799-4e62-93d1-b471d3b4d958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb65b269-2429-41d2-8838-a25aa33fa244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb65b269-2429-41d2-8838-a25aa33fa244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc', 'volume_name': 'volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5640432d-3a0a-4b6c-a10e-ba10d99ce188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5640432d-3a0a-4b6c-a10e-ba10d99ce188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c47a5a-1349-43a6-9e3a-f896cafb5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Volume f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc', 'volume_size': 1} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1769058454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb4dfd57afa498eb1ad2b33379538a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:35Z,use_quota=True,user_id='443d59fd6ed04aaa923cd54f6aaa78ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Creating volume f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:34 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:34 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc 1073741824 Jul 08 19:47:34 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Flow 'volume_create_manager' (925c8ca7-f790-4ab8-ab2e-072556538eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905ad6bc-fcbc-4484-9095-c8f15aa1e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905ad6bc-fcbc-4484-9095-c8f15aa1e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-877319441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e04ffa-6ff5-4489-bdad-88a4d545b448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb4dfd57afa498eb1ad2b33379538a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:36Z,use_quota=True,user_id='443d59fd6ed04aaa923cd54f6aaa78ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40910661-3f43-4642-9150-d8f68aeafd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40910661-3f43-4642-9150-d8f68aeafd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:35 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d93665-fc2b-4b7a-b5eb-e164a63ff018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d93665-fc2b-4b7a-b5eb-e164a63ff018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e04ffa-6ff5-4489-bdad-88a4d545b448', 'volume_name': 'volume-13e04ffa-6ff5-4489-bdad-88a4d545b448', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4b05b5-a231-4447-8223-68bac162a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4b05b5-a231-4447-8223-68bac162a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a9dba5-f9e5-43f4-9036-179efeab58b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:35 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Volume 13e04ffa-6ff5-4489-bdad-88a4d545b448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e04ffa-6ff5-4489-bdad-88a4d545b448', 'volume_size': 1} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.200s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:47:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:47:36 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc 1073741824" returned: 0 in 1.276s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:36 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc Jul 08 19:47:36 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "cinder-345e7ce0-d1de-4e0c-95b3-44e417dac524-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-345e7ce0-d1de-4e0c-95b3-44e417dac524-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "cinder-quobyte-345e7ce0-d1de-4e0c-95b3-44e417dac524" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-quobyte-345e7ce0-d1de-4e0c-95b3-44e417dac524" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfd7f2-052d-41eb-be13-f15239515452]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:37 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 Jul 08 19:47:37 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:37 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" returned: 0 in 0.870s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-877319441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e04ffa-6ff5-4489-bdad-88a4d545b448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb4dfd57afa498eb1ad2b33379538a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:36Z,use_quota=True,user_id='443d59fd6ed04aaa923cd54f6aaa78ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Creating volume 13e04ffa-6ff5-4489-bdad-88a4d545b448 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:37 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c47a5a-1349-43a6-9e3a-f896cafb5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426431e2-4f46-4f43-964d-f253c044f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:37 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 1073741824 Jul 08 19:47:37 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:37 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Volume volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc (f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc): created successfully Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426431e2-4f46-4f43-964d-f253c044f43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Flow 'volume_create_manager' (464dc5bb-e40b-4672-8306-df699803ef53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:37 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-acb8ccac-b917-4512-8ccb-d96fe382900d tempest-TestServerVolumeAttachmentScenario-927936814 None] Created volume successfully. Jul 08 19:47:37 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524" returned: 0 in 1.112s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:38 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524 Jul 08 19:47:38 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:38 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 1073741824" returned: 0 in 1.279s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:38 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 Jul 08 19:47:38 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:38 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-345e7ce0-d1de-4e0c-95b3-44e417dac524" returned: 0 in 0.936s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-quobyte-345e7ce0-d1de-4e0c-95b3-44e417dac524" released by "delete_volume" :: held 2.092s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:38 devstack cinder-volume[87172]: WARNING cinder.quota [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125337236-1475478898 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125337236-1475478898, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:47:38 devstack cinder-volume[87172]: WARNING cinder.quota [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125337236-1475478898 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1125337236-1475478898, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Created reservations ['0b476c80-1791-4378-a977-b45df79b834a', '3b6d107f-0889-4e53-96e2-090aabc686c0', 'ae473e59-49db-47f3-a91d-9744019c23d4', '867d7d6b-f4af-43ab-9994-030d760596e5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:39 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:39 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:39 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448" returned: 0 in 0.844s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a9dba5-f9e5-43f4-9036-179efeab58b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e04ffa-6ff5-4489-bdad-88a4d545b448', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab29771-de14-4bba-b37d-db79b5a0ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:39 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Volume volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 (13e04ffa-6ff5-4489-bdad-88a4d545b448): created successfully Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab29771-de14-4bba-b37d-db79b5a0ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Flow 'volume_create_manager' (925c8ca7-f790-4ab8-ab2e-072556538eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a61ada8e-07a1-4750-b1b6-030fa68fdfed tempest-TestServerVolumeAttachmentScenario-927936814 None] Created volume successfully. Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-af8ff574-af10-40a3-aa00-ace2ce540ace-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Lock "cinder-af8ff574-af10-40a3-aa00-ace2ce540ace-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Acquiring lock "cinder-quobyte-af8ff574-af10-40a3-aa00-ace2ce540ace" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-af8ff574-af10-40a3-aa00-ace2ce540ace" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff5fc25-b1d5-46aa-b333-ed2b13dd785a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:40 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.998s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:40 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deleted volume successfully. Jul 08 19:47:40 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:47:40 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:40 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7c8275a4-3d87-49f6-af8d-e0d3c4f16c83 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-345e7ce0-d1de-4e0c-95b3-44e417dac524-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:40 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 1.063s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:41 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace Jul 08 19:47:41 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:42 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af8ff574-af10-40a3-aa00-ace2ce540ace" returned: 0 in 1.048s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Lock "cinder-quobyte-af8ff574-af10-40a3-aa00-ace2ce540ace" released by "delete_volume" :: held 2.222s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Created reservations ['49975ea8-e61d-401c-a0ff-138c074627d7', '7449c128-a366-4b7f-b7c9-de034c36e4ea', '5ecafbce-8fc6-459b-8b3f-ef907c1640a4', '87422cd2-5397-4d78-9e41-bf93dc96febc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:42 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:42 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:43 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.851s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:43 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Deleted volume successfully. Jul 08 19:47:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d283a830-020e-4ef6-9853-ef98431ec43d tempest-TestStampPattern-1987150457 None] Lock "cinder-af8ff574-af10-40a3-aa00-ace2ce540ace-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (2eb3f881-6189-4604-8078-4ec2017e08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eacc63-e8b5-4058-aaa7-2cfb72ef1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eacc63-e8b5-4058-aaa7-2cfb72ef1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878330053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd07c36-05d6-4386-ad3c-bae6df25994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:44Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831508a6-703c-4d30-94af-abec36e6b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831508a6-703c-4d30-94af-abec36e6b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbacf9c-56b4-4ee0-b2be-5575fda54363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbacf9c-56b4-4ee0-b2be-5575fda54363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd07c36-05d6-4386-ad3c-bae6df25994e', 'volume_name': 'volume-8fd07c36-05d6-4386-ad3c-bae6df25994e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdd32a0-e5fe-4a74-aa9b-e31d56619635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdd32a0-e5fe-4a74-aa9b-e31d56619635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a45f010-5bc5-4144-bb35-2c676e1ed803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume 8fd07c36-05d6-4386-ad3c-bae6df25994e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd07c36-05d6-4386-ad3c-bae6df25994e', 'volume_size': 1} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-878330053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd07c36-05d6-4386-ad3c-bae6df25994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:44Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Creating volume 8fd07c36-05d6-4386-ad3c-bae6df25994e {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:44 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:44 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e 1073741824 Jul 08 19:47:44 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:45 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e 1073741824" returned: 0 in 1.017s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:45 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e Jul 08 19:47:45 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:45 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-fca409a7-ade3-4dd9-bf76-7522a1927b9c req-c06f3ab4-fadd-41e7-900a-6b2ac45c257b tempest-TestInstancesWithCinderVolumes-1562878143 None] Terminate volume connection completed successfully. Jul 08 19:47:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-fca409a7-ade3-4dd9-bf76-7522a1927b9c req-c06f3ab4-fadd-41e7-900a-6b2ac45c257b tempest-TestInstancesWithCinderVolumes-1562878143 None] Deleting attachment 9d1b9ce4-d87a-4927-b381-4a5a2c1b1575. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:47:46 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e" returned: 0 in 0.740s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a45f010-5bc5-4144-bb35-2c676e1ed803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd07c36-05d6-4386-ad3c-bae6df25994e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78418d19-cc66-4775-a5fe-062aa9581aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume volume-8fd07c36-05d6-4386-ad3c-bae6df25994e (8fd07c36-05d6-4386-ad3c-bae6df25994e): created successfully Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78418d19-cc66-4775-a5fe-062aa9581aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (2eb3f881-6189-4604-8078-4ec2017e08c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c7bb3f13-3d46-4b24-b852-a9b31fecfc4c tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created volume successfully. Jul 08 19:47:47 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (d2d4a8ba-e9a6-4323-a66d-aec83f7961b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db9f8d0-7894-4cf7-92fa-ad78289e4a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db9f8d0-7894-4cf7-92fa-ad78289e4a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397499948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b301829-5553-45d2-8607-74a43acae722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:48Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b579b94-28a1-4a13-9102-d8700e8cabce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b579b94-28a1-4a13-9102-d8700e8cabce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c456a6-48ac-4da3-b37a-edc5ff92a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c456a6-48ac-4da3-b37a-edc5ff92a8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b301829-5553-45d2-8607-74a43acae722', 'volume_name': 'volume-6b301829-5553-45d2-8607-74a43acae722', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2f669d-40f3-4f15-9148-1b2abaa58b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2f669d-40f3-4f15-9148-1b2abaa58b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8dbea2-630f-4006-85de-2131a783605b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume 6b301829-5553-45d2-8607-74a43acae722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b301829-5553-45d2-8607-74a43acae722', 'volume_size': 1} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1397499948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b301829-5553-45d2-8607-74a43acae722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:48Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Creating volume 6b301829-5553-45d2-8607-74a43acae722 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:48 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:48 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 1073741824 Jul 08 19:47:48 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (9209a649-34b2-4d49-bd5a-9271a1d2592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5908934-eea0-4999-961f-b386da72fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5908934-eea0-4999-961f-b386da72fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647293267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d97f699-b3a8-44e8-b85e-a1c835db2b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:49Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0752536-2264-4ff5-bc2e-93cb82d4956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0752536-2264-4ff5-bc2e-93cb82d4956e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452ed808-4fe0-42d3-8767-d29f4bff5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452ed808-4fe0-42d3-8767-d29f4bff5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d97f699-b3a8-44e8-b85e-a1c835db2b71', 'volume_name': 'volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812f1044-cfd9-4546-98a3-f65c91637837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812f1044-cfd9-4546-98a3-f65c91637837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c87ce3-f324-4abc-a16f-f8523c813940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume 7d97f699-b3a8-44e8-b85e-a1c835db2b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71', 'volume_size': 1} Jul 08 19:47:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (95909d77-6682-49c0-8b38-51a05cc0234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd98899f-84b7-4ad9-b522-4dfe4a1c60f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd98899f-84b7-4ad9-b522-4dfe4a1c60f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389666511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:49Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744548fb-cf2a-4447-8e2c-8e2caadcd3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744548fb-cf2a-4447-8e2c-8e2caadcd3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41573c9a-774a-4187-bdc9-68ef3effe79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41573c9a-774a-4187-bdc9-68ef3effe79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef', 'volume_name': 'volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c3a33b-294c-4125-b987-5882722727af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c3a33b-294c-4125-b987-5882722727af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cadc6c-b733-46af-92d5-a851f0de26bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:49 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume 479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef', 'volume_size': 1} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:49 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 1073741824" returned: 0 in 1.525s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "cinder-5365ad86-6bab-4e88-84a9-0a4ac2092142-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:49 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 Jul 08 19:47:49 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-5365ad86-6bab-4e88-84a9-0a4ac2092142-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "cinder-quobyte-5365ad86-6bab-4e88-84a9-0a4ac2092142" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:47:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-quobyte-5365ad86-6bab-4e88-84a9-0a4ac2092142" acquired by "delete_volume" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3461e2-486d-4678-b034-0907b03bb303]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (30bad7ca-2bee-4ada-b4c9-67533160ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e8005b-b4f5-4685-bbb2-16659fdd7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:50 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:47:50 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e8005b-b4f5-4685-bbb2-16659fdd7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737068354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbd50d7-0640-4e10-ac7c-64518241f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:50Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d37a64-ad2b-447f-ad57-f68fbdbbcc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d37a64-ad2b-447f-ad57-f68fbdbbcc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd6e05d-e6a1-41d8-8f31-8b2817b36807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd6e05d-e6a1-41d8-8f31-8b2817b36807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbd50d7-0640-4e10-ac7c-64518241f21f', 'volume_name': 'volume-8dbd50d7-0640-4e10-ac7c-64518241f21f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff5dd9-b0ed-4b1f-99e6-77447a4687e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff5dd9-b0ed-4b1f-99e6-77447a4687e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1993f66a-86fe-4c03-a05a-c36e197cd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:50 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume 8dbd50d7-0640-4e10-ac7c-64518241f21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbd50d7-0640-4e10-ac7c-64518241f21f', 'volume_size': 1} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:50 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722" returned: 0 in 1.137s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] <== create_volume: return (2769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.773s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647293267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d97f699-b3a8-44e8-b85e-a1c835db2b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:49Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Creating volume 7d97f699-b3a8-44e8-b85e-a1c835db2b71 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:50 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:50 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 1073741824 Jul 08 19:47:50 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:47:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (8c4e038e-6fbd-42d9-9e55-bbe6f644f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62785f3d-9ef1-4d8a-9b91-4eca5cbbf0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8dbea2-630f-4006-85de-2131a783605b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b301829-5553-45d2-8607-74a43acae722', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cf01bb-5375-402f-a8a9-5b50a29df5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:51 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume volume-6b301829-5553-45d2-8607-74a43acae722 (6b301829-5553-45d2-8607-74a43acae722): created successfully Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cf01bb-5375-402f-a8a9-5b50a29df5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (d2d4a8ba-e9a6-4323-a66d-aec83f7961b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62785f3d-9ef1-4d8a-9b91-4eca5cbbf0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140987925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:51Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b99682b-0ae9-41c0-a697-ae7e5463b71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b99682b-0ae9-41c0-a697-ae7e5463b71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b02a31-28b0-4cbf-bccc-996d07a8825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b02a31-28b0-4cbf-bccc-996d07a8825a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787', 'volume_name': 'volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf54d9ed-ebba-4df3-b725-d227315c12f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf54d9ed-ebba-4df3-b725-d227315c12f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4f056e-d0d1-4224-aea9-51baf510952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:51 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume 200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787', 'volume_size': 1} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2d6a4b58-a401-4b2b-a89b-977ed818e3e2 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created volume successfully. Jul 08 19:47:51 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 0 in 1.277s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:51 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:47:51 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:52 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 1073741824" returned: 0 in 1.198s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:52 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 Jul 08 19:47:52 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:52 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 1 in 0.950s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:52 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142 Jul 08 19:47:52 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:52 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71" returned: 0 in 0.855s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389666511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:49Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Creating volume 479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:53 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:53 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef 1073741824 Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c87ce3-f324-4abc-a16f-f8523c813940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:53 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842df3c4-1002-4e0a-9654-15c96800fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:53 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 (7d97f699-b3a8-44e8-b85e-a1c835db2b71): created successfully Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842df3c4-1002-4e0a-9654-15c96800fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (9209a649-34b2-4d49-bd5a-9271a1d2592e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5365ad86-6bab-4e88-84a9-0a4ac2092142" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-quobyte-5365ad86-6bab-4e88-84a9-0a4ac2092142" released by "delete_volume" :: held 3.132s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bfbb6623-a44a-4540-b2c1-f6a24a31b549 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created volume successfully. Jul 08 19:47:53 devstack cinder-volume[87172]: WARNING cinder.quota [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313853565-355130880 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313853565-355130880, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:47:53 devstack cinder-volume[87172]: WARNING cinder.quota [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313853565-355130880 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1313853565-355130880, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Created reservations ['b36c6ffa-50d3-462f-a57c-ed137cffa4b4', 'b1706854-0f6b-4d1f-bf75-e63b2f703591', '6bb3c249-ae78-4d22-b7b6-45fa8d6733e6', 'ff783980-6ed5-4c70-bdb0-5e8e57ee15cd'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:53 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:47:53 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:54 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef 1073741824" returned: 0 in 1.034s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:54 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.790s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:54 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:47:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Deleted volume successfully. Jul 08 19:47:54 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef Jul 08 19:47:54 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a0029928-1a7a-4cab-9a4e-be41efb4dd40 tempest-TestInstancesWithCinderVolumes-1562878143 None] Lock "cinder-5365ad86-6bab-4e88-84a9-0a4ac2092142-delete_volume" released by "delete_volume" :: held 4.302s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:47:55 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef" returned: 0 in 0.958s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.585s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737068354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbd50d7-0640-4e10-ac7c-64518241f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:50Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Creating volume 8dbd50d7-0640-4e10-ac7c-64518241f21f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:55 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:55 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f 1073741824 Jul 08 19:47:55 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cadc6c-b733-46af-92d5-a851f0de26bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c11fd12-7347-4515-89f9-c8f63604e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef (479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef): created successfully Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c11fd12-7347-4515-89f9-c8f63604e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (95909d77-6682-49c0-8b38-51a05cc0234c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:55 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3b2a70ab-3f5d-4420-9a1e-dd788a8a9483 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created volume successfully. Jul 08 19:47:56 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f 1073741824" returned: 0 in 1.316s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:56 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f Jul 08 19:47:56 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:57 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f" returned: 0 in 0.974s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] <== create_volume: return (2395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.361s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1140987925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57350036df0349e7aece550080ec45e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:47:51Z,use_quota=True,user_id='943afae54a424277903820bea7dbb1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Creating volume 200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:47:57 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:57 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 1073741824 Jul 08 19:47:57 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1993f66a-86fe-4c03-a05a-c36e197cd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbd50d7-0640-4e10-ac7c-64518241f21f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce1395d-61a4-4e36-ab74-bf41966d139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:47:57 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume volume-8dbd50d7-0640-4e10-ac7c-64518241f21f (8dbd50d7-0640-4e10-ac7c-64518241f21f): created successfully Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce1395d-61a4-4e36-ab74-bf41966d139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:47:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (30bad7ca-2bee-4ada-b4c9-67533160ae54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:47:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b0c1f951-780a-4b24-aea5-130e741c017f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created volume successfully. Jul 08 19:47:58 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 08 19:47:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 1073741824" returned: 0 in 1.463s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:47:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:47:59 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 Jul 08 19:47:59 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:00 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787" returned: 0 in 1.004s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] <== create_volume: return (2536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.539s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4f056e-d0d1-4224-aea9-51baf510952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e83f16-c0b2-44a8-84af-60395714ca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Volume volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 (200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787): created successfully Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e83f16-c0b2-44a8-84af-60395714ca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Flow 'volume_create_manager' (8c4e038e-6fbd-42d9-9e55-bbe6f644f572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-38a73450-e3e7-42e9-96bb-d5cb085a856b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created volume successfully. Jul 08 19:48:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-quobyte-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39264bf-f8ce-4794-a2df-e89df75ba882]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:01 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 Jul 08 19:48:01 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:02 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787" returned: 0 in 1.309s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:02 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787 Jul 08 19:48:02 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:03 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787" returned: 0 in 1.008s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787" released by "delete_volume" :: held 2.388s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created reservations ['4ae15165-f781-4d75-a169-d8aab7cf2b41', '9f7ad6f4-fe04-4438-9ca5-b4efe27d2136', '9578f1be-6081-4f88-aab7-23e5cec142ce', 'f92761ad-d136-4697-a358-0d9fe63f2a53'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:04 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:04 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-8dbd50d7-0640-4e10-ac7c-64518241f21f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-8dbd50d7-0640-4e10-ac7c-64518241f21f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-quobyte-8dbd50d7-0640-4e10-ac7c-64518241f21f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-8dbd50d7-0640-4e10-ac7c-64518241f21f" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:04 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc051d3a-5bff-44e8-9538-fc85f749bbc6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:05 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f Jul 08 19:48:05 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:05 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.046s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:05 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Deleted volume successfully. Jul 08 19:48:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b360a970-2817-4902-9c5f-6861e42ab98b tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-200d3ccf-e2f8-44d3-84b3-eb1f7d7ef787-delete_volume" released by "delete_volume" :: held 3.846s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:05 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f" returned: 0 in 0.965s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:05 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f Jul 08 19:48:05 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:06 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8dbd50d7-0640-4e10-ac7c-64518241f21f" returned: 0 in 0.854s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-8dbd50d7-0640-4e10-ac7c-64518241f21f" released by "delete_volume" :: held 1.880s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created reservations ['ddb48dfd-db33-4952-8f08-67543091c560', 'c70d1e62-10e2-488b-91d2-6d8a2fed3eef', '6a25b5df-e887-4353-a508-0aafb7e662a6', 'd66b8c77-f8aa-4ea4-b517-1ca3abe25e04'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:06 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:06 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-quobyte-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef" acquired by "delete_volume" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e2711-addf-49f1-a13e-e7d23537fff9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:07 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef Jul 08 19:48:07 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:07 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.939s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Deleted volume successfully. Jul 08 19:48:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e18056a4-8604-455d-b433-edc0b54cbd84 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-8dbd50d7-0640-4e10-ac7c-64518241f21f-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:08 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef" returned: 0 in 1.266s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:08 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef Jul 08 19:48:08 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Flow 'volume_create_manager' (0982486a-b657-4d12-9516-7c4988d76d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b28c22-b0e7-4bec-84d6-0c9637a03007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b28c22-b0e7-4bec-84d6-0c9637a03007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd9b6a1-a5a9-40f9-a903-450969bb3a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3274928d0c4c47df914f25d62f8eb697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:09Z,use_quota=True,user_id='21112d4a94184fcfae2babb120b3dae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2b186ad-1202-4079-b524-5f084ceb2f19),volume_type_id=f2b186ad-1202-4079-b524-5f084ceb2f19)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ed5b64-67b9-4be7-a9db-03f19aa93089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ed5b64-67b9-4be7-a9db-03f19aa93089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46a6418-7526-4b22-a823-c16e506004c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:08 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46a6418-7526-4b22-a823-c16e506004c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cd9b6a1-a5a9-40f9-a903-450969bb3a84', 'volume_name': 'volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84', 'volume_size': 1, 'image_id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/088f5422-08c0-44f7-905b-ac6deea9b28c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06a250fe0f86e4e9a51411d37c99db6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3274928d0c4c47df914f25d62f8eb697', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf9fa77f2e06722692cd5ce528f20592e149104d6ea892b939b03adbaa72e1c4ccb0d6763c92629c77633aa75878082ace3d78d986af6aefdd3b21a616765271', 'id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'created_at': datetime.datetime(2026, 7, 8, 17, 48, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 48, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/088f5422-08c0-44f7-905b-ac6deea9b28c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db375a28-8375-42ec-a586-08aacccd8175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db375a28-8375-42ec-a586-08aacccd8175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ef3d5-2a1e-4521-a3ae-fc29e6cc016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:09 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Volume 3cd9b6a1-a5a9-40f9-a903-450969bb3a84: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84', 'volume_size': 1, 'image_id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/088f5422-08c0-44f7-905b-ac6deea9b28c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06a250fe0f86e4e9a51411d37c99db6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3274928d0c4c47df914f25d62f8eb697', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf9fa77f2e06722692cd5ce528f20592e149104d6ea892b939b03adbaa72e1c4ccb0d6763c92629c77633aa75878082ace3d78d986af6aefdd3b21a616765271', 'id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'created_at': datetime.datetime(2026, 7, 8, 17, 48, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 48, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/088f5422-08c0-44f7-905b-ac6deea9b28c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Trying to clone 3cd9b6a1-a5a9-40f9-a903-450969bb3a84 from image 088f5422-08c0-44f7-905b-ac6deea9b28c at location (None, [{'url': 'file:///opt/stack/data/glance/images/088f5422-08c0-44f7-905b-ac6deea9b28c', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:48:09 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Image download 0.00 MB at 0.00 MB/s Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e2373-56e1-4ee5-965d-51dba2966f07]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:09 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD Jul 08 19:48:09 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:09 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef" returned: 0 in 1.290s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef" released by "delete_volume" :: held 2.641s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created reservations ['c22028f5-f8fc-435c-84f7-5a16744fae17', 'd51732ad-77ab-4dc5-b312-20b868ed8860', '98d3a681-0cfb-491e-a320-73c0b13a2645', '29d26705-0a61-4a80-98af-45fe911fce76'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:10 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:10 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-7d97f699-b3a8-44e8-b85e-a1c835db2b71-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-7d97f699-b3a8-44e8-b85e-a1c835db2b71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-quobyte-7d97f699-b3a8-44e8-b85e-a1c835db2b71" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-7d97f699-b3a8-44e8-b85e-a1c835db2b71" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8be5663-da39-4600-b8cd-4984fc699b4b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:11 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD" returned: 0 in 1.349s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:11 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 Jul 08 19:48:11 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:11 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.036s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Deleted volume successfully. Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6ce132a4-a1ac-435f-a098-6e23a270c16f tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-479e1187-3b9e-4ccc-b0ae-8f9f1c2c1cef-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:11 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD Jul 08 19:48:11 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:11 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71" returned: 0 in 0.962s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:11 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71 Jul 08 19:48:11 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:12 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD" returned: 1 in 0.895s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Temporary image 088f5422-08c0-44f7-905b-ac6deea9b28c is fetched for user 21112d4a94184fcfae2babb120b3dae9. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf344d-21f3-4f9a-b8b0-c6183a2c15aa]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:12 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD Jul 08 19:48:12 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:12 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7d97f699-b3a8-44e8-b85e-a1c835db2b71" returned: 0 in 0.669s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-7d97f699-b3a8-44e8-b85e-a1c835db2b71" released by "delete_volume" :: held 1.706s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created reservations ['9a0b70d5-bbf0-4c84-87f6-796d2ecb2a82', '4e65be86-f688-4899-8fb1-30af928d06c1', 'faa63990-0352-400a-b7d3-a0c62ecf6e29', '11ed1d16-18d7-4b9b-b743-2c413b953136'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:12 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:12 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:12 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD" returned: 0 in 0.873s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-6b301829-5553-45d2-8607-74a43acae722-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-6b301829-5553-45d2-8607-74a43acae722-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-quobyte-6b301829-5553-45d2-8607-74a43acae722" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-6b301829-5553-45d2-8607-74a43acae722" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:13 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD Jul 08 19:48:13 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9769c3-538e-4f7e-af99-78e186fa31a1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:13 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 Jul 08 19:48:13 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:13 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.769s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Deleted volume successfully. Jul 08 19:48:13 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dccf2ec8-c4c1-450e-8055-7c6821e819b0 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-7d97f699-b3a8-44e8-b85e-a1c835db2b71-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:14 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD" returned: 1 in 1.064s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd9b6a1-a5a9-40f9-a903-450969bb3a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3274928d0c4c47df914f25d62f8eb697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:09Z,use_quota=True,user_id='21112d4a94184fcfae2babb120b3dae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2b186ad-1202-4079-b524-5f084ceb2f19),volume_type_id=f2b186ad-1202-4079-b524-5f084ceb2f19)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Creating volume 3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:48:14 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:14 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 1073741824 Jul 08 19:48:14 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:14 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722" returned: 0 in 0.869s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:14 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722 Jul 08 19:48:14 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:14 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6b301829-5553-45d2-8607-74a43acae722" returned: 0 in 0.732s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-6b301829-5553-45d2-8607-74a43acae722" released by "delete_volume" :: held 1.671s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:14 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created reservations ['8019b4c8-b63d-41b3-bcab-2ca0f45a56e2', 'bca9da0e-74c9-4c84-88d9-a1e9b94c1d37', 'ce67e2f0-d68d-4962-8d23-ef45e024955d', 'c0a1738c-3a68-40ef-a83b-fa2beec81cd6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:15 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 1073741824" returned: 0 in 1.001s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:15 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:15 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:15 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:15 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-8fd07c36-05d6-4386-ad3c-bae6df25994e-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-8fd07c36-05d6-4386-ad3c-bae6df25994e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "cinder-quobyte-8fd07c36-05d6-4386-ad3c-bae6df25994e" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-8fd07c36-05d6-4386-ad3c-bae6df25994e" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c031ad5-cf23-45f0-abb4-4261a877f1d1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:15 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e Jul 08 19:48:15 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:15 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Deleted volume successfully. Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5d911f38-5021-453d-abd8-e583de2d5b97 tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-6b301829-5553-45d2-8607-74a43acae722-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:15 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 0 in 0.820s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:15 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Attempting download of 088f5422-08c0-44f7-905b-ac6deea9b28c ((None, [{'url': 'file:///opt/stack/data/glance/images/088f5422-08c0-44f7-905b-ac6deea9b28c', 'metadata': {}}])) to volume 3cd9b6a1-a5a9-40f9-a903-450969bb3a84. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:48:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a730afae-6b62-4b6f-af71-d35641f50bd6]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:16 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8 Jul 08 19:48:16 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:16 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e" returned: 0 in 0.932s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:16 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e Jul 08 19:48:16 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:16 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8" returned: 0 in 0.852s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:17 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8 Jul 08 19:48:17 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:17 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fd07c36-05d6-4386-ad3c-bae6df25994e" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-quobyte-8fd07c36-05d6-4386-ad3c-bae6df25994e" released by "delete_volume" :: held 1.726s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Created reservations ['d7f7db7d-2541-4999-817e-421490269859', '2ef5e807-630a-418d-a3c9-afcfff399cb0', 'd4545b11-e824-4782-90da-8f74cda0f732', 'edbb436f-7850-4b2c-82ff-19f1b6bdc29d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:17 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:17 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:17 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8" returned: 1 in 0.869s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_088f5422-08c0-44f7-905b-ac6deea9b28c_nn7h5jr8' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae65fd1-8e81-49bc-a5be-8928a63f2787]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:18 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD Jul 08 19:48:18 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:18 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.996s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:18 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Deleted volume successfully. Jul 08 19:48:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7f7fe190-424d-44eb-92d0-b90a9e8cdebd tempest-CreateVolumesFromSourceVolumeTest-1712524368 None] Lock "cinder-8fd07c36-05d6-4386-ad3c-bae6df25994e-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:18 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD" returned: 0 in 1.022s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:18 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD Jul 08 19:48:18 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:19 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD" returned: 1 in 0.853s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:48:19 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] 088f5422-08c0-44f7-905b-ac6deea9b28c was raw, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:48:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:19 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:19 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:20 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 0 in 0.842s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:20 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_088f5422-08c0-44f7-905b-ac6deea9b28c_xqvvlf1ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:48:20 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 19:48:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:20 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 1G Jul 08 19:48:20 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:21 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 1G" returned: 0 in 1.052s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[29163b3f-0a45-4bf5-a37f-b7cb165e0c63]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:21 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:21 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:22 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:22 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:22 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:23 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 1 in 0.985s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Downloaded image 088f5422-08c0-44f7-905b-ac6deea9b28c ((None, [{'url': 'file:///opt/stack/data/glance/images/088f5422-08c0-44f7-905b-ac6deea9b28c', 'metadata': {}}])) to volume 3cd9b6a1-a5a9-40f9-a903-450969bb3a84 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Temporary image 088f5422-08c0-44f7-905b-ac6deea9b28c for user 21112d4a94184fcfae2babb120b3dae9 is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Marking volume 3cd9b6a1-a5a9-40f9-a903-450969bb3a84 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Copying metadata from image 088f5422-08c0-44f7-905b-ac6deea9b28c to 3cd9b6a1-a5a9-40f9-a903-450969bb3a84. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Creating volume glance metadata for volume 3cd9b6a1-a5a9-40f9-a903-450969bb3a84 backed by image 088f5422-08c0-44f7-905b-ac6deea9b28c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '06a250fe0f86e4e9a51411d37c99db6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=92,cinder:INSERT=27,cinder:UPDATE=130,cinder:DELETE=12 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104ef3d5-2a1e-4521-a3ae-fc29e6cc016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84', 'volume_size': 1, 'image_id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/088f5422-08c0-44f7-905b-ac6deea9b28c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '06a250fe0f86e4e9a51411d37c99db6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3274928d0c4c47df914f25d62f8eb697', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf9fa77f2e06722692cd5ce528f20592e149104d6ea892b939b03adbaa72e1c4ccb0d6763c92629c77633aa75878082ace3d78d986af6aefdd3b21a616765271', 'id': '088f5422-08c0-44f7-905b-ac6deea9b28c', 'created_at': datetime.datetime(2026, 7, 8, 17, 48, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 48, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/088f5422-08c0-44f7-905b-ac6deea9b28c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d1f606-6bac-4e73-9bfa-f42bab29b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:23 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Volume volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 (3cd9b6a1-a5a9-40f9-a903-450969bb3a84): created successfully Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d1f606-6bac-4e73-9bfa-f42bab29b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Flow 'volume_create_manager' (0982486a-b657-4d12-9516-7c4988d76d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0fa2c7a1-a543-4f1a-a6df-e5b44618a3f4 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Created volume successfully. Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Acquiring lock "cinder-3cd9b6a1-a5a9-40f9-a903-450969bb3a84-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "cinder-3cd9b6a1-a5a9-40f9-a903-450969bb3a84-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:23 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=103,cinder:INSERT=46,cinder:UPDATE=139,cinder:DELETE=8 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:48:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Acquiring lock "cinder-quobyte-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "cinder-quobyte-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[875daddc-309d-4ae7-aa30-1ff76e3c6da2]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:24 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:24 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:24 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 0 in 0.828s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:25 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:25 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:25 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 1 in 0.814s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:48:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:25 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84 Jul 08 19:48:25 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[681cb4fd-12a4-416f-9c12-32f4373692df]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:26 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:26 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc Jul 08 19:48:26 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "cinder-quobyte-3cd9b6a1-a5a9-40f9-a903-450969bb3a84" released by "delete_volume" :: held 2.476s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:26 devstack cinder-volume[87172]: WARNING cinder.quota [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:48:26 devstack cinder-volume[87172]: WARNING cinder.quota [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Created reservations ['e4c42847-f4ed-48fa-90f9-9098bafe6c67', '71390bee-1f36-439b-b4da-67a9df44bf36', 'e940b08e-120c-4082-996f-d7ea4e344fab', '47ecd1ca-c680-4dc3-a739-b45444d6aace'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:26 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:26 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:27 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" returned: 0 in 0.798s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b49a12c-d6b7-4a7a-909c-6fc948caabb0', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:48:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-baea8925-f070-4ac9-aed0-eefa81127b38 req-4b505247-f831-40d3-aa11-6ce1c8d9b4e9 tempest-TestServerVolumeAttachmentScenario-927936814 None] attachment_update completed successfully. Jul 08 19:48:27 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.735s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:27 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Deleted volume successfully. Jul 08 19:48:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f3b34b34-a819-4b26-b610-5265a44bae29 tempest-VolumeAndVolumeTypeFromImageTest-1531169509 None] Lock "cinder-3cd9b6a1-a5a9-40f9-a903-450969bb3a84-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Flow 'volume_create_manager' (f13e3108-255b-43bf-b1c3-9ca3f16238fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40db664-d9f6-41d1-a316-224503ed4c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40db664-d9f6-41d1-a316-224503ed4c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80928627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3837dd-0801-4eb2-b6d9-3e0d4a63401a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd6bde57bff4c11ba7849c73561d050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:34Z,use_quota=True,user_id='0d4fd459d5974430a14500faf1380fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b48855-b1c4-456c-b680-4a50f8cd2d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b48855-b1c4-456c-b680-4a50f8cd2d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f60db4-77fe-494c-94d4-d204e77e8fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f60db4-77fe-494c-94d4-d204e77e8fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3837dd-0801-4eb2-b6d9-3e0d4a63401a', 'volume_name': 'volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd507946-f280-4e7c-922a-4b0286102d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd507946-f280-4e7c-922a-4b0286102d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2608bdf2-481b-4118-bacc-2492a637537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Volume 0d3837dd-0801-4eb2-b6d9-3e0d4a63401a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a', 'volume_size': 1} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80928627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3837dd-0801-4eb2-b6d9-3e0d4a63401a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd6bde57bff4c11ba7849c73561d050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:34Z,use_quota=True,user_id='0d4fd459d5974430a14500faf1380fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Creating volume 0d3837dd-0801-4eb2-b6d9-3e0d4a63401a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:48:34 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:34 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a 1073741824 Jul 08 19:48:34 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:34 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:34 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:35 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a 1073741824" returned: 0 in 1.072s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:35 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a Jul 08 19:48:35 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:35 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.898s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:48:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:48:36 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a" returned: 0 in 0.665s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2608bdf2-481b-4118-bacc-2492a637537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea98c7f-659b-4039-92db-cb36d8c75c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:36 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Volume volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a (0d3837dd-0801-4eb2-b6d9-3e0d4a63401a): created successfully Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea98c7f-659b-4039-92db-cb36d8c75c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Flow 'volume_create_manager' (f13e3108-255b-43bf-b1c3-9ca3f16238fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fbd0373e-e269-4f83-b338-b4a11999e329 tempest-ProjectReaderTests-166671808 None] Created volume successfully. Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Acquiring lock "cinder-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Lock "cinder-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Acquiring lock "cinder-quobyte-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Lock "cinder-quobyte-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd09e149-34e7-47b4-8394-1ff00f985a3e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:37 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a Jul 08 19:48:37 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eab212-82dc-4a01-8d70-aa281c5ce2e2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:38 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 Jul 08 19:48:38 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:38 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a" returned: 0 in 0.833s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:38 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a Jul 08 19:48:38 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:38 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-13e04ffa-6ff5-4489-bdad-88a4d545b448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adc76d67-6931-493b-b773-a88e26abfaaf', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:48:38 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-48682ab8-4344-487c-ad57-43bdee15b9c7 req-034c1c84-cd48-4089-bc74-b1402a55a678 tempest-TestServerVolumeAttachmentScenario-927936814 None] attachment_update completed successfully. Jul 08 19:48:39 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a" returned: 0 in 0.710s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Lock "cinder-quobyte-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a" released by "delete_volume" :: held 1.605s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Created reservations ['4d0f6228-9c89-4fe4-ba0e-ac3438126306', '43f62342-f2fb-4d1f-989c-71f690fe3139', '1eb21b04-4f91-427c-855d-5b4ca8eb7816', 'f0d05d9e-2cd8-4cc7-9834-b5572a4b26e4'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:39 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:39 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:39 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.719s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:39 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Deleted volume successfully. Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47af80a4-50df-47fa-8309-814efaed84a2 tempest-ProjectReaderTests-166671808 None] Lock "cinder-0d3837dd-0801-4eb2-b6d9-3e0d4a63401a-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Flow 'volume_create_manager' (26862832-e391-46c6-bc8f-cf923973b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b15967b-f2c1-487b-9120-b0bfcc427fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b15967b-f2c1-487b-9120-b0bfcc427fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793466425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2ed073-14d5-4089-bdb1-47084ca3741f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd6bde57bff4c11ba7849c73561d050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:40Z,use_quota=True,user_id='0d4fd459d5974430a14500faf1380fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486e404f-fb42-43c8-8f59-4e3dad57b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486e404f-fb42-43c8-8f59-4e3dad57b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a501887-b79a-4614-bd63-7af34367ce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a501887-b79a-4614-bd63-7af34367ce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2ed073-14d5-4089-bdb1-47084ca3741f', 'volume_name': 'volume-9d2ed073-14d5-4089-bdb1-47084ca3741f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51e9424-de49-491b-8990-5a4e690dc984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51e9424-de49-491b-8990-5a4e690dc984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f7e93c-84b8-4f49-8dbd-e04e82fb2a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:40 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Volume 9d2ed073-14d5-4089-bdb1-47084ca3741f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2ed073-14d5-4089-bdb1-47084ca3741f', 'volume_size': 1} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793466425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2ed073-14d5-4089-bdb1-47084ca3741f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd6bde57bff4c11ba7849c73561d050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:40Z,use_quota=True,user_id='0d4fd459d5974430a14500faf1380fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Creating volume 9d2ed073-14d5-4089-bdb1-47084ca3741f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:48:40 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:48:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:40 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f 1073741824 Jul 08 19:48:40 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:41 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f 1073741824" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:41 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f Jul 08 19:48:41 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:42 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f" returned: 0 in 0.733s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f7e93c-84b8-4f49-8dbd-e04e82fb2a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2ed073-14d5-4089-bdb1-47084ca3741f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f91f201-5930-4110-a19b-77fd9b652229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:42 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Volume volume-9d2ed073-14d5-4089-bdb1-47084ca3741f (9d2ed073-14d5-4089-bdb1-47084ca3741f): created successfully Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f91f201-5930-4110-a19b-77fd9b652229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Flow 'volume_create_manager' (26862832-e391-46c6-bc8f-cf923973b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:42 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c55f454a-7093-4991-8ad6-05f57544476d tempest-ProjectReaderTests-166671808 None] Created volume successfully. Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Acquiring lock "cinder-9d2ed073-14d5-4089-bdb1-47084ca3741f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Lock "cinder-9d2ed073-14d5-4089-bdb1-47084ca3741f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Acquiring lock "cinder-quobyte-9d2ed073-14d5-4089-bdb1-47084ca3741f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Lock "cinder-quobyte-9d2ed073-14d5-4089-bdb1-47084ca3741f" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[228719b8-54c9-4437-b23f-3ebf6aef388a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:42 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f Jul 08 19:48:42 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:43 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f" returned: 0 in 0.749s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:43 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f Jul 08 19:48:43 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:43 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9d2ed073-14d5-4089-bdb1-47084ca3741f" returned: 0 in 0.709s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Lock "cinder-quobyte-9d2ed073-14d5-4089-bdb1-47084ca3741f" released by "delete_volume" :: held 1.496s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Created reservations ['0988742a-e9de-4c2c-ab58-55fac396e2c4', 'b7b62683-35f0-4bff-a073-863eea035b72', 'e74706a5-8151-46ac-b137-13292b176ade', 'b4fa043c-bfce-4631-820b-54db6716ed55'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:44 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:48:44 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-d5d9ca4e-d9a8-4acf-b939-d76715daba66 req-16f210aa-aab4-4e2a-9ec3-e665cd6d3f34 tempest-TestServerVolumeAttachmentScenario-927936814 None] Terminate volume connection completed successfully. Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-d5d9ca4e-d9a8-4acf-b939-d76715daba66 req-16f210aa-aab4-4e2a-9ec3-e665cd6d3f34 tempest-TestServerVolumeAttachmentScenario-927936814 None] Deleting attachment adc76d67-6931-493b-b773-a88e26abfaaf. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:48:44 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.783s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:44 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:48:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Deleted volume successfully. Jul 08 19:48:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e87a56dd-42fd-446f-8d46-20b5aa060406 tempest-ProjectReaderTests-166671808 None] Lock "cinder-9d2ed073-14d5-4089-bdb1-47084ca3741f-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:48:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-51b34a73-4048-4aa0-ba3e-597dd1cb0209 req-d6cf0b4c-140f-4a18-b350-d1531aac40bd tempest-TestServerVolumeAttachmentScenario-927936814 None] Terminate volume connection completed successfully. Jul 08 19:48:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-51b34a73-4048-4aa0-ba3e-597dd1cb0209 req-d6cf0b4c-140f-4a18-b350-d1531aac40bd tempest-TestServerVolumeAttachmentScenario-927936814 None] Deleting attachment 3b49a12c-d6b7-4a7a-909c-6fc948caabb0. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:48:54 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Flow 'volume_create_manager' (261fc67f-fb5b-4b23-a509-7272f9a3893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50ca890-f835-496a-aa2a-01f2396224d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50ca890-f835-496a-aa2a-01f2396224d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-753870120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df00f8a8-947a-4cfa-ba8e-d04b3928b751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae2fb5a3e4f4ca8af18dd69d0761df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:56Z,use_quota=True,user_id='afd2a06fe6b44e18937dcb64308f6c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf850734-00b7-4516-865c-6c6e1f52b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf850734-00b7-4516-865c-6c6e1f52b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b047fec-929e-4e80-8d90-2411805411b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b047fec-929e-4e80-8d90-2411805411b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df00f8a8-947a-4cfa-ba8e-d04b3928b751', 'volume_name': 'volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b4bdbf-a2b2-4f02-9c3e-8a1e2b3af82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b4bdbf-a2b2-4f02-9c3e-8a1e2b3af82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904ac974-0145-418f-ae27-472de93955c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Volume df00f8a8-947a-4cfa-ba8e-d04b3928b751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751', 'volume_size': 1} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-753870120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df00f8a8-947a-4cfa-ba8e-d04b3928b751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae2fb5a3e4f4ca8af18dd69d0761df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:48:56Z,use_quota=True,user_id='afd2a06fe6b44e18937dcb64308f6c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Creating volume df00f8a8-947a-4cfa-ba8e-d04b3928b751 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:48:55 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:48:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:55 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 1073741824 Jul 08 19:48:55 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:56 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 1073741824" returned: 0 in 0.857s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:56 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 Jul 08 19:48:56 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:48:57 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904ac974-0145-418f-ae27-472de93955c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2196f834-0502-49af-a764-8b77d0304b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:48:57 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Volume volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 (df00f8a8-947a-4cfa-ba8e-d04b3928b751): created successfully Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2196f834-0502-49af-a764-8b77d0304b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:48:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Flow 'volume_create_manager' (261fc67f-fb5b-4b23-a509-7272f9a3893a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:48:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0b237564-eaf6-4e06-b70e-b33becd1ce68 tempest-TestMinimumBasicScenario-140952933 None] Created volume successfully. Jul 08 19:48:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "cinder-13e04ffa-6ff5-4489-bdad-88a4d545b448-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-13e04ffa-6ff5-4489-bdad-88a4d545b448-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "cinder-quobyte-13e04ffa-6ff5-4489-bdad-88a4d545b448" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:48:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-quobyte-13e04ffa-6ff5-4489-bdad-88a4d545b448" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:48:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6801dcbe-f352-4c3c-8dd1-847b5296f66b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:48:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:48:59 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 Jul 08 19:48:59 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:00 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:00 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448 Jul 08 19:49:00 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:01 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-13e04ffa-6ff5-4489-bdad-88a4d545b448" returned: 0 in 0.696s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-quobyte-13e04ffa-6ff5-4489-bdad-88a4d545b448" released by "delete_volume" :: held 1.536s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4786809-fa00-468c-b89a-4537a0311585]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Created reservations ['2fe8e423-136a-457e-8163-c20a3e949884', 'b89160a4-be64-4207-bb5b-30dede157fa1', '069968e1-4e05-4324-a4ce-5f48a0476971', 'd1b99b45-4c1e-4ee8-b3cc-d04c6842097e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:01 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 Jul 08 19:49:01 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:01 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:01 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "cinder-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "cinder-quobyte-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-quobyte-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e22658-cd26-4a31-8521-054086d4ae42]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:02 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Deleted volume successfully. Jul 08 19:49:02 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c6c392ad-9a43-4dc8-b0ac-4356a59dfbea tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-13e04ffa-6ff5-4489-bdad-88a4d545b448-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751" returned: 0 in 0.908s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.928s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc', 'name': 'volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5861df4c-ffde-439d-a3f7-ab5608d90f89', 'enforce_multipath': True} {{(pid=87172) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4934}} Jul 08 19:49:02 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc Jul 08 19:49:02 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-37e4c156-61cc-4abc-8727-023d43252a1f req-29f52615-d545-4682-b438-8c0fe5fbeede tempest-TestMinimumBasicScenario-140952933 None] attachment_update completed successfully. Jul 08 19:49:02 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" returned: 0 in 0.851s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:02 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc Jul 08 19:49:02 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:03 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" returned: 0 in 0.660s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-quobyte-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc" released by "delete_volume" :: held 1.568s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Created reservations ['baaaa034-71e0-411e-9c71-01de092622a3', '41ec7bc1-7f07-4905-a196-e4ed15f3dd73', 'e911b2ca-f03f-4e12-8880-4f14b2ba8bf6', 'f461ed24-1b05-42d5-86ea-cb23e7a4f5b1'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:03 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:03 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:04 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.661s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:04 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Deleted volume successfully. Jul 08 19:49:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a552e735-c0b6-473e-ac28-a7a34bda12f6 tempest-TestServerVolumeAttachmentScenario-927936814 None] Lock "cinder-f7b7cd35-ffa0-4c54-88c6-27b9948eb2cc-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:13 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=53,cinder:INSERT=13,cinder:UPDATE=52,cinder:DELETE=2 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:49:14 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (a82266a5-6b18-41b4-83da-31b2d2ad9bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e7c1f4-a479-4092-a0fe-02c594f1ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e7c1f4-a479-4092-a0fe-02c594f1ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833351880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd67ac96-49c1-4958-b2c2-1f14732c3f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:15Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ab514a-a4be-416f-ae94-3924cc6f44dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ab514a-a4be-416f-ae94-3924cc6f44dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26963083-1b52-4d27-b83c-badd80a20133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26963083-1b52-4d27-b83c-badd80a20133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd67ac96-49c1-4958-b2c2-1f14732c3f62', 'volume_name': 'volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75559d21-8374-4869-92ae-a4a01a92b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75559d21-8374-4869-92ae-a4a01a92b210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfc4b25-061f-4b84-8e22-da4de6b647d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Volume dd67ac96-49c1-4958-b2c2-1f14732c3f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62', 'volume_size': 1} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-833351880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd67ac96-49c1-4958-b2c2-1f14732c3f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:15Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Creating volume dd67ac96-49c1-4958-b2c2-1f14732c3f62 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:15 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:15 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 1073741824 Jul 08 19:49:15 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (af90e310-ba98-4d52-8e8e-08e5127fe249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b77bbcd-f3a1-484f-a176-fc6b4a2e1743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b77bbcd-f3a1-484f-a176-fc6b4a2e1743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1948042888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3f8eac-c2b4-4dc3-92bf-28038f1012e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:15Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cb932d-085c-4e0e-9386-15a5651cb874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30cb932d-085c-4e0e-9386-15a5651cb874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f36af31-5ed2-41c8-931d-0a55a2111ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f36af31-5ed2-41c8-931d-0a55a2111ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3f8eac-c2b4-4dc3-92bf-28038f1012e4', 'volume_name': 'volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f67254-44a4-4796-a62f-5b44269a7ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f67254-44a4-4796-a62f-5b44269a7ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4a86c9-c283-4f24-abce-bfc83257ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Volume 8f3f8eac-c2b4-4dc3-92bf-28038f1012e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4', 'volume_size': 1} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (cf00b52e-8a0a-413c-8d29-c273a7bb9852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c0cbb8-fb25-4d37-bbd2-5fa0a40b2321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c0cbb8-fb25-4d37-bbd2-5fa0a40b2321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513624657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b8306-0f36-4a09-80fe-2c8737ba9446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:16Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c0812a-8a4d-4e9c-92c5-dc9442b8071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c0812a-8a4d-4e9c-92c5-dc9442b8071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0bb8ad-48cc-43af-bc17-3494b6ecef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0bb8ad-48cc-43af-bc17-3494b6ecef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420b8306-0f36-4a09-80fe-2c8737ba9446', 'volume_name': 'volume-420b8306-0f36-4a09-80fe-2c8737ba9446', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d050473-9491-4794-9c94-0897b2f70443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d050473-9491-4794-9c94-0897b2f70443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1040ee92-3322-4769-8dbf-8a9c585c1341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Volume 420b8306-0f36-4a09-80fe-2c8737ba9446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420b8306-0f36-4a09-80fe-2c8737ba9446', 'volume_size': 1} Jul 08 19:49:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:16 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 1073741824" returned: 0 in 0.919s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (20c5ab01-33a0-4dbe-9b0f-60ddc5625797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b671f4c-ce9a-40b4-8d88-93024879794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b671f4c-ce9a-40b4-8d88-93024879794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93019689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e91cf96-ef56-4a87-b799-b302bc0cb689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:16Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1870b8-91c7-4925-a005-ca4fbdc69769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1870b8-91c7-4925-a005-ca4fbdc69769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 Jul 08 19:49:16 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a69910-441f-4809-a0e3-102192358a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a69910-441f-4809-a0e3-102192358a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e91cf96-ef56-4a87-b799-b302bc0cb689', 'volume_name': 'volume-4e91cf96-ef56-4a87-b799-b302bc0cb689', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf6245e-fe3e-480e-893a-c8cf3072734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf6245e-fe3e-480e-893a-c8cf3072734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eef9ab6-e732-465d-92ac-673476a97829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Volume 4e91cf96-ef56-4a87-b799-b302bc0cb689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e91cf96-ef56-4a87-b799-b302bc0cb689', 'volume_size': 1} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (88281e08-27e7-41a6-bb84-2d62da48e02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4955ca-8194-461f-96bc-f39ca6323d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4955ca-8194-461f-96bc-f39ca6323d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254482440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7e1ca8-b640-479e-b303-d19eee7cecc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:17Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcbf617-189b-45b7-8ba8-b8aab7270124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcbf617-189b-45b7-8ba8-b8aab7270124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e8710-9258-4bda-acdb-21424e6714d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e8710-9258-4bda-acdb-21424e6714d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7e1ca8-b640-479e-b303-d19eee7cecc5', 'volume_name': 'volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fb2f95-1cbb-436b-976d-5cf8b2eca5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fb2f95-1cbb-436b-976d-5cf8b2eca5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ebb420-33bd-451a-bfca-7ca86a5f4c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:16 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Volume bf7e1ca8-b640-479e-b303-d19eee7cecc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5', 'volume_size': 1} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:16 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62" returned: 0 in 0.769s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1948042888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3f8eac-c2b4-4dc3-92bf-28038f1012e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:15Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Creating volume 8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:16 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:16 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 1073741824 Jul 08 19:49:16 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfc4b25-061f-4b84-8e22-da4de6b647d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f85a6e2-4eb5-4d30-8478-4681d121cf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Volume volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 (dd67ac96-49c1-4958-b2c2-1f14732c3f62): created successfully Jul 08 19:49:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f85a6e2-4eb5-4d30-8478-4681d121cf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (a82266a5-6b18-41b4-83da-31b2d2ad9bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-831dc5aa-a3c3-436b-91d5-ee260b1a4336 tempest-CreateVolumesFromImageTest-424614373 None] Created volume successfully. Jul 08 19:49:17 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 1073741824" returned: 0 in 0.836s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:17 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 Jul 08 19:49:17 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:18 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4" returned: 0 in 0.670s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.676s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513624657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b8306-0f36-4a09-80fe-2c8737ba9446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:16Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Creating volume 420b8306-0f36-4a09-80fe-2c8737ba9446 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:18 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:18 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 1073741824 Jul 08 19:49:18 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4a86c9-c283-4f24-abce-bfc83257ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a84f078-061b-44ae-91af-b170337605a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:18 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Volume volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 (8f3f8eac-c2b4-4dc3-92bf-28038f1012e4): created successfully Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a84f078-061b-44ae-91af-b170337605a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (af90e310-ba98-4d52-8e8e-08e5127fe249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7088a641-53c4-4bd5-9785-18d19f0602bb tempest-CreateVolumesFromImageTest-424614373 None] Created volume successfully. Jul 08 19:49:19 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 1073741824" returned: 0 in 0.808s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:19 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 Jul 08 19:49:19 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:19 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446" returned: 0 in 0.643s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.743s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93019689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e91cf96-ef56-4a87-b799-b302bc0cb689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:16Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Creating volume 4e91cf96-ef56-4a87-b799-b302bc0cb689 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:19 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1040ee92-3322-4769-8dbf-8a9c585c1341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420b8306-0f36-4a09-80fe-2c8737ba9446', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:20 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 1073741824 Jul 08 19:49:20 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82f2035-9436-4262-ab78-9892404ff900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Volume volume-420b8306-0f36-4a09-80fe-2c8737ba9446 (420b8306-0f36-4a09-80fe-2c8737ba9446): created successfully Jul 08 19:49:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82f2035-9436-4262-ab78-9892404ff900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (cf00b52e-8a0a-413c-8d29-c273a7bb9852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-10181aa8-c0f3-423b-9422-fa346f7a787b tempest-CreateVolumesFromImageTest-424614373 None] Created volume successfully. Jul 08 19:49:20 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 1073741824" returned: 0 in 0.806s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:20 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 Jul 08 19:49:20 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:21 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689" returned: 0 in 0.647s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.817s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254482440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7e1ca8-b640-479e-b303-d19eee7cecc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125a3d76df57497588eba9c8a5cc1b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:17Z,use_quota=True,user_id='9012b24d13bb478f85d3705af68c8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Creating volume bf7e1ca8-b640-479e-b303-d19eee7cecc5 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:21 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:21 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 1073741824 Jul 08 19:49:21 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eef9ab6-e732-465d-92ac-673476a97829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e91cf96-ef56-4a87-b799-b302bc0cb689', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3985a1e9-2bd4-41a4-aab0-bc356a6adf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Volume volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 (4e91cf96-ef56-4a87-b799-b302bc0cb689): created successfully Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3985a1e9-2bd4-41a4-aab0-bc356a6adf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (20c5ab01-33a0-4dbe-9b0f-60ddc5625797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f81b93f1-f002-4b01-ac16-8f5e72eb094f tempest-CreateVolumesFromImageTest-424614373 None] Created volume successfully. Jul 08 19:49:22 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 1073741824" returned: 0 in 0.775s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:22 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 Jul 08 19:49:22 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:22 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5" returned: 0 in 0.633s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ebb420-33bd-451a-bfca-7ca86a5f4c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fb1f40-198e-4b05-9dfa-35afd2163b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Volume volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 (bf7e1ca8-b640-479e-b303-d19eee7cecc5): created successfully Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fb1f40-198e-4b05-9dfa-35afd2163b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Flow 'volume_create_manager' (88281e08-27e7-41a6-bb84-2d62da48e02f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d34463a0-0ad9-4fee-9048-7146efd79a82 tempest-CreateVolumesFromImageTest-424614373 None] Created volume successfully. Jul 08 19:49:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-bf7e1ca8-b640-479e-b303-d19eee7cecc5-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-bf7e1ca8-b640-479e-b303-d19eee7cecc5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-quobyte-bf7e1ca8-b640-479e-b303-d19eee7cecc5" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-bf7e1ca8-b640-479e-b303-d19eee7cecc5" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:23 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dcccab-572e-40e2-81d0-ce65c893b047]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:23 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 Jul 08 19:49:23 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:24 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5" returned: 0 in 0.810s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:24 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5 Jul 08 19:49:24 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:24 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bf7e1ca8-b640-479e-b303-d19eee7cecc5" returned: 0 in 0.670s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-bf7e1ca8-b640-479e-b303-d19eee7cecc5" released by "delete_volume" :: held 1.521s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Created reservations ['4d4f2919-0fe2-4f4a-89aa-f75ef997085b', 'd5ad1b7a-19f0-4c9e-a355-300e6f44da63', '74f2f12a-29c2-4cd9-9cb5-802b57086066', '98111e43-18d5-4222-b6dd-c059e9eeb73e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:24 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:24 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-4e91cf96-ef56-4a87-b799-b302bc0cb689-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-4e91cf96-ef56-4a87-b799-b302bc0cb689-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-quobyte-4e91cf96-ef56-4a87-b799-b302bc0cb689" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-4e91cf96-ef56-4a87-b799-b302bc0cb689" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b94aca6-bb54-41d8-ab06-41a49856c06d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:25 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.782s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:25 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 Jul 08 19:49:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Deleted volume successfully. Jul 08 19:49:25 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-fc9f46d4-60e0-4599-82cb-0de08548de05 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-bf7e1ca8-b640-479e-b303-d19eee7cecc5-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:26 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:26 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689 Jul 08 19:49:26 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:26 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-4e91cf96-ef56-4a87-b799-b302bc0cb689" returned: 0 in 0.660s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-4e91cf96-ef56-4a87-b799-b302bc0cb689" released by "delete_volume" :: held 1.501s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Created reservations ['095f998d-a1e1-49b6-b2a9-e53f2b4a820a', '736b3dce-fbe2-4ce2-9880-47499a01e973', '442a912d-39ee-4b4f-80a2-753be872447b', '6cf9e4a9-282a-4b83-ae5b-36d2b6b434f1'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:27 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:27 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-420b8306-0f36-4a09-80fe-2c8737ba9446-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-420b8306-0f36-4a09-80fe-2c8737ba9446-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-quobyte-420b8306-0f36-4a09-80fe-2c8737ba9446" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-420b8306-0f36-4a09-80fe-2c8737ba9446" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[67df58e9-b047-42d6-b3cb-dcafdfe502b7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:27 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.695s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Deleted volume successfully. Jul 08 19:49:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d90ab84e-4272-429c-aad7-4a545f5092cc tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-4e91cf96-ef56-4a87-b799-b302bc0cb689-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:27 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 Jul 08 19:49:27 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:28 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446" returned: 0 in 0.783s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:28 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446 Jul 08 19:49:28 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:29 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-420b8306-0f36-4a09-80fe-2c8737ba9446" returned: 0 in 0.617s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-420b8306-0f36-4a09-80fe-2c8737ba9446" released by "delete_volume" :: held 1.448s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Created reservations ['d6670840-b955-45c5-95e4-54f55b4b1072', 'ccda4114-3e0c-459a-a84a-7bf0c374111b', '0052a8d8-29d1-42c3-88ab-e770281741ed', 'f1a84f18-0dde-4c83-b7aa-e51044dd211e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:29 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:29 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:29 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.673s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:29 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Deleted volume successfully. Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ffe120ae-0535-4e39-84f0-136b336a6145 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-420b8306-0f36-4a09-80fe-2c8737ba9446-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-quobyte-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9779113-a474-4eb0-958a-8a2ffce1f5f4]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:30 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 Jul 08 19:49:30 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:30 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:30 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4 Jul 08 19:49:30 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:31 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4" returned: 0 in 0.619s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4" released by "delete_volume" :: held 1.384s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Created reservations ['d0d5b532-d2f0-4044-aea0-f89a4cb65388', 'e1386f64-ade7-4fa5-befe-66caa92e06fc', 'ec91a19c-19dd-4d43-807e-4e5d275664e8', '85fb5f86-eaa5-4623-b037-1b36e31d6781'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:31 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:31 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:32 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-dd67ac96-49c1-4958-b2c2-1f14732c3f62-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.632s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Deleted volume successfully. Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-dd67ac96-49c1-4958-b2c2-1f14732c3f62-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9423180c-aeb0-47af-93ea-2dd1db80aea1 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-8f3f8eac-c2b4-4dc3-92bf-28038f1012e4-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "cinder-quobyte-dd67ac96-49c1-4958-b2c2-1f14732c3f62" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-dd67ac96-49c1-4958-b2c2-1f14732c3f62" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e7ebc8-84d0-4e5f-bf0d-5181ff71ca15]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:32 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 Jul 08 19:49:32 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:33 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62" returned: 0 in 0.738s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:33 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62 Jul 08 19:49:33 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:33 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd67ac96-49c1-4958-b2c2-1f14732c3f62" returned: 0 in 0.622s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-quobyte-dd67ac96-49c1-4958-b2c2-1f14732c3f62" released by "delete_volume" :: held 1.395s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Created reservations ['d7b00961-a8dd-4c90-b724-3d40bb56649e', '09cae38e-3091-4881-8a66-a305e2137e6c', 'b8b1ce43-fb67-4836-a3f8-a72a978312c1', '53de2065-f8ca-43cd-9b40-91c6394eb21a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:33 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:33 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:34 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.626s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Deleted volume successfully. Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a819695f-dc89-45d0-b603-4177a9b8ef97 tempest-CreateVolumesFromImageTest-424614373 None] Lock "cinder-dd67ac96-49c1-4958-b2c2-1f14732c3f62-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:34 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:34 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:35 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.688s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:49:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:49:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (b332fc62-7fd2-4d91-9dae-88b747cabb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aba054a-ff6a-44ec-a8a2-ecbe947b1d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aba054a-ff6a-44ec-a8a2-ecbe947b1d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662994838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d398451-bda9-4599-9657-854901d69268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:37Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23b8fa2-d1ef-49a4-8b42-e7e4fdfa2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23b8fa2-d1ef-49a4-8b42-e7e4fdfa2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a1d662-c1ae-410d-86ee-7b4aa9270366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a1d662-c1ae-410d-86ee-7b4aa9270366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d398451-bda9-4599-9657-854901d69268', 'volume_name': 'volume-5d398451-bda9-4599-9657-854901d69268', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdf43d8-2503-4fc7-8b74-01069df27fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdf43d8-2503-4fc7-8b74-01069df27fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6190d98-7804-4be9-9b2c-1d2c5411889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:37 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume 5d398451-bda9-4599-9657-854901d69268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d398451-bda9-4599-9657-854901d69268', 'volume_size': 1} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-662994838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d398451-bda9-4599-9657-854901d69268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:37Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating volume 5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:37 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:37 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 1073741824 Jul 08 19:49:37 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:38 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 1073741824" returned: 0 in 0.761s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:38 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 Jul 08 19:49:38 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:39 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268" returned: 0 in 0.640s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6190d98-7804-4be9-9b2c-1d2c5411889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d398451-bda9-4599-9657-854901d69268', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8218dbf1-b7f7-4d06-85f0-a6b33f421243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:39 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume volume-5d398451-bda9-4599-9657-854901d69268 (5d398451-bda9-4599-9657-854901d69268): created successfully Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8218dbf1-b7f7-4d06-85f0-a6b33f421243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (b332fc62-7fd2-4d91-9dae-88b747cabb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-115b34f3-1489-4314-9048-30ec6b473648 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created volume successfully. Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating offline snapshot e4ee6ead-8053-4ec4-8d64-9832e9ebd141 of volume 5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d958ac-fbce-4bb9-9a2f-621c8124208a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:39 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 Jul 08 19:49:39 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:40 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268" returned: 0 in 0.745s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:40 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 1G Jul 08 19:49:40 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:41 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 1G" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d398451-bda9-4599-9657-854901d69268 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:41 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d398451-bda9-4599-9657-854901d69268 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 Jul 08 19:49:41 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:41 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d398451-bda9-4599-9657-854901d69268 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141" returned: 0 in 0.655s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:41 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 is being set with open permissions: ugo+rw Jul 08 19:49:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:41 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 Jul 08 19:49:41 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:42 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141" returned: 0 in 0.617s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:42 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info Jul 08 19:49:42 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:43 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info" returned: 0 in 0.690s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:43 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info is being set with open permissions: ugo+rw Jul 08 19:49:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:43 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info Jul 08 19:49:43 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:43 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.info" returned: 0 in 0.621s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.206s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-fd46e3d2-ce10-4ec7-bb38-d3844d1869ab tempest-CreateVolumesFromSnapshotTest-1841134457 None] Create snapshot completed successfully Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (682a80d3-d3cd-47a6-8d4d-790c2e7b7750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c5bc05-25ab-4aa7-837b-808cec25a4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c5bc05-25ab-4aa7-837b-808cec25a4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2096381647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edada410-e11a-406f-b1d3-8663b2a8581a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:45Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d5166f-ae7d-43d1-a78d-2c5eafcee640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d5166f-ae7d-43d1-a78d-2c5eafcee640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab0c34f-1738-462b-ac8f-418a1608a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab0c34f-1738-462b-ac8f-418a1608a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edada410-e11a-406f-b1d3-8663b2a8581a', 'volume_name': 'volume-edada410-e11a-406f-b1d3-8663b2a8581a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1693dc6-1764-4e48-a429-e2446c9b8701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1693dc6-1764-4e48-a429-e2446c9b8701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f688f1-8a05-4b63-a279-22011d606502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume edada410-e11a-406f-b1d3-8663b2a8581a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edada410-e11a-406f-b1d3-8663b2a8581a', 'volume_size': 1} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2096381647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edada410-e11a-406f-b1d3-8663b2a8581a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:45Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating volume edada410-e11a-406f-b1d3-8663b2a8581a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:45 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:45 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a 1073741824 Jul 08 19:49:45 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (9012d9ad-0053-4f94-8b86-d29398af18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f8ba56-7fb8-469b-bdac-7c6f632283b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f8ba56-7fb8-469b-bdac-7c6f632283b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2137914355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8103ef1b-be33-4bb8-88bc-dfc15ffcda8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:46Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823f2fff-8250-4c32-ba7f-973e7de7badc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823f2fff-8250-4c32-ba7f-973e7de7badc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4fa513-82da-4c9a-b4ab-dbbdd1b932e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4fa513-82da-4c9a-b4ab-dbbdd1b932e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8103ef1b-be33-4bb8-88bc-dfc15ffcda8c', 'volume_name': 'volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af5cf58-769a-486a-a85e-9f4ccd55e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af5cf58-769a-486a-a85e-9f4ccd55e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd30347c-da51-4e62-817b-a4871765545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume 8103ef1b-be33-4bb8-88bc-dfc15ffcda8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c', 'volume_size': 1} Jul 08 19:49:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (c71a52f0-c4d3-47a2-a924-d2ed134b016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc94e10-0553-4a1e-91d0-14f5028fac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc94e10-0553-4a1e-91d0-14f5028fac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551539501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620a24e5-6cd0-402d-b164-7cb767f8cc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:46Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0211ce82-15a1-434b-8a34-def8b9b3b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0211ce82-15a1-434b-8a34-def8b9b3b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601225b7-abfd-418b-aa3a-14ead0a78cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601225b7-abfd-418b-aa3a-14ead0a78cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620a24e5-6cd0-402d-b164-7cb767f8cc72', 'volume_name': 'volume-620a24e5-6cd0-402d-b164-7cb767f8cc72', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ec6796-56a0-498b-8898-c0d3f5ab8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ec6796-56a0-498b-8898-c0d3f5ab8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa579be-9fd2-4629-9e84-eab9dd75e992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume 620a24e5-6cd0-402d-b164-7cb767f8cc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620a24e5-6cd0-402d-b164-7cb767f8cc72', 'volume_size': 1} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:46 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (21405c4c-76ca-46b5-be5c-06387ab971e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc83958a-9079-4c57-9e37-a0a261e2803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a 1073741824" returned: 0 in 1.194s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc83958a-9079-4c57-9e37-a0a261e2803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135614130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3444d389-e927-411d-b533-6bd2b02a3b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:47Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983f5f90-39ee-42d4-ad55-55e7ead76574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983f5f90-39ee-42d4-ad55-55e7ead76574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc3490b-14d8-4281-b8fb-ebdf8dd7c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc3490b-14d8-4281-b8fb-ebdf8dd7c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3444d389-e927-411d-b533-6bd2b02a3b0e', 'volume_name': 'volume-3444d389-e927-411d-b533-6bd2b02a3b0e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397215af-81a0-475e-9bcc-bc28e7be6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397215af-81a0-475e-9bcc-bc28e7be6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e54b9e-b127-4064-a871-30525c16bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume 3444d389-e927-411d-b533-6bd2b02a3b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3444d389-e927-411d-b533-6bd2b02a3b0e', 'volume_size': 1} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:46 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a Jul 08 19:49:46 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (f9a9af9d-9223-4e2b-a67c-4004310199d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94884c4f-03f7-4308-8390-8c08cfe19dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94884c4f-03f7-4308-8390-8c08cfe19dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750931839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb07565-6af4-457f-a6ac-fc1dcb118c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:47Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669aba46-163b-4d87-9a7a-117359d14fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669aba46-163b-4d87-9a7a-117359d14fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b964d1b0-c903-490f-8335-020ddba3a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b964d1b0-c903-490f-8335-020ddba3a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb07565-6af4-457f-a6ac-fc1dcb118c59', 'volume_name': 'volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e274bc8e-4792-41e2-a2b9-ec08a50829e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e274bc8e-4792-41e2-a2b9-ec08a50829e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393e2152-a69e-429b-9be2-f8937ad1a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:47 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume ffb07565-6af4-457f-a6ac-fc1dcb118c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59', 'volume_size': 1} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:47 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a" returned: 0 in 0.741s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2137914355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8103ef1b-be33-4bb8-88bc-dfc15ffcda8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:46Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating volume 8103ef1b-be33-4bb8-88bc-dfc15ffcda8c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:47 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f688f1-8a05-4b63-a279-22011d606502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edada410-e11a-406f-b1d3-8663b2a8581a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:47 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c 1073741824 Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfc5a4a-693c-4d42-b174-681824bf050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:47 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:47 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume volume-edada410-e11a-406f-b1d3-8663b2a8581a (edada410-e11a-406f-b1d3-8663b2a8581a): created successfully Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfc5a4a-693c-4d42-b174-681824bf050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:47 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (682a80d3-d3cd-47a6-8d4d-790c2e7b7750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:47 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6f7b08ad-5382-4d34-9665-45688bcf7b06 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created volume successfully. Jul 08 19:49:48 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c 1073741824" returned: 0 in 0.915s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:48 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c Jul 08 19:49:48 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:49 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c" returned: 0 in 0.646s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.856s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551539501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620a24e5-6cd0-402d-b164-7cb767f8cc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:46Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating volume 620a24e5-6cd0-402d-b164-7cb767f8cc72 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:49 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd30347c-da51-4e62-817b-a4871765545d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ce1e0c-cee3-4c6b-bf8b-d5eabbe9e40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:49 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 1073741824 Jul 08 19:49:49 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:49 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c (8103ef1b-be33-4bb8-88bc-dfc15ffcda8c): created successfully Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ce1e0c-cee3-4c6b-bf8b-d5eabbe9e40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (9012d9ad-0053-4f94-8b86-d29398af18d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5b856b82-6f20-4cb7-80da-c108a3489136 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created volume successfully. Jul 08 19:49:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [req-0fa9a8ff-350c-4678-b893-9c03ee6514ab req-ba582ecb-2d55-4707-8c74-ab192e635456 tempest-TestMinimumBasicScenario-140952933 None] Terminate volume connection completed successfully. Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [req-0fa9a8ff-350c-4678-b893-9c03ee6514ab req-ba582ecb-2d55-4707-8c74-ab192e635456 tempest-TestMinimumBasicScenario-140952933 None] Deleting attachment 5861df4c-ffde-439d-a3f7-ab5608d90f89. {{(pid=87172) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5065}} Jul 08 19:49:49 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 1073741824" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:50 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 Jul 08 19:49:50 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:50 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72" returned: 0 in 0.629s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.950s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135614130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3444d389-e927-411d-b533-6bd2b02a3b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:47Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating volume 3444d389-e927-411d-b533-6bd2b02a3b0e {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:50 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:50 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e 1073741824 Jul 08 19:49:50 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa579be-9fd2-4629-9e84-eab9dd75e992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620a24e5-6cd0-402d-b164-7cb767f8cc72', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a429b16f-dc04-469a-8bfe-ac34356de32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:50 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 (620a24e5-6cd0-402d-b164-7cb767f8cc72): created successfully Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a429b16f-dc04-469a-8bfe-ac34356de32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (c71a52f0-c4d3-47a2-a924-d2ed134b016c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:50 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-927550fe-b9f7-45fe-8769-585238ac05d2 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created volume successfully. Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Acquiring lock "cinder-df00f8a8-947a-4cfa-ba8e-d04b3928b751-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Lock "cinder-df00f8a8-947a-4cfa-ba8e-d04b3928b751-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Acquiring lock "cinder-quobyte-df00f8a8-947a-4cfa-ba8e-d04b3928b751" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:51 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e 1073741824" returned: 0 in 0.870s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Lock "cinder-quobyte-df00f8a8-947a-4cfa-ba8e-d04b3928b751" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fbc328-a935-4227-863a-d8b796eac9bd]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:51 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e Jul 08 19:49:51 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:51 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 Jul 08 19:49:51 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:52 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.119s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750931839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb07565-6af4-457f-a6ac-fc1dcb118c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c966a4c9380543caaafb338c75ae8e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:49:47Z,use_quota=True,user_id='ace457147ad64324a4209f6c8e9d23f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Creating volume ffb07565-6af4-457f-a6ac-fc1dcb118c59 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:49:52 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e54b9e-b127-4064-a871-30525c16bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3444d389-e927-411d-b533-6bd2b02a3b0e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a742c3be-ac9a-46c0-8ce8-2486a1a47567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:52 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 1073741824 Jul 08 19:49:52 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:52 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume volume-3444d389-e927-411d-b533-6bd2b02a3b0e (3444d389-e927-411d-b533-6bd2b02a3b0e): created successfully Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a742c3be-ac9a-46c0-8ce8-2486a1a47567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (21405c4c-76ca-46b5-be5c-06387ab971e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:52 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:52 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-851d69be-4cc2-4c61-90fb-93c32e525083 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created volume successfully. Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751" returned: 0 in 0.763s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:52 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751 Jul 08 19:49:52 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:53 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-df00f8a8-947a-4cfa-ba8e-d04b3928b751" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Lock "cinder-quobyte-df00f8a8-947a-4cfa-ba8e-d04b3928b751" released by "delete_volume" :: held 1.530s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:53 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 1073741824" returned: 0 in 0.844s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Created reservations ['9a5ea8e0-3f16-40ad-81f0-8fe70659d314', '4c834680-80cb-4243-bbd2-01cdfdd9a7d3', '3ac32657-efe5-42d8-8b8c-57c5e9eed452', 'f202d913-d3bf-4138-8fc1-333c78584eb7'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:53 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 Jul 08 19:49:53 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:53 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:53 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:53 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59" returned: 0 in 0.705s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:53 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393e2152-a69e-429b-9be2-f8937ad1a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ec2826-e20c-4659-8cf2-244d2f7f3a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.681s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Deleted volume successfully. Jul 08 19:49:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Volume volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 (ffb07565-6af4-457f-a6ac-fc1dcb118c59): created successfully Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ec2826-e20c-4659-8cf2-244d2f7f3a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Flow 'volume_create_manager' (f9a9af9d-9223-4e2b-a67c-4004310199d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:49:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9c93cfbd-5527-415b-8290-1d62b520e109 tempest-TestMinimumBasicScenario-140952933 None] Lock "cinder-df00f8a8-947a-4cfa-ba8e-d04b3928b751-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1fe31992-664a-4ac4-b8bb-a4069993043c tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created volume successfully. Jul 08 19:49:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-ffb07565-6af4-457f-a6ac-fc1dcb118c59-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-ffb07565-6af4-457f-a6ac-fc1dcb118c59-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-ffb07565-6af4-457f-a6ac-fc1dcb118c59" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-ffb07565-6af4-457f-a6ac-fc1dcb118c59" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a2ee11-a30f-4518-89fa-4db8d818fcc7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:54 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 Jul 08 19:49:54 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:55 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59" returned: 0 in 0.754s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:55 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59 Jul 08 19:49:55 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:56 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ffb07565-6af4-457f-a6ac-fc1dcb118c59" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-ffb07565-6af4-457f-a6ac-fc1dcb118c59" released by "delete_volume" :: held 1.579s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['71933cd9-48ab-4642-a417-3ece5ad71334', '58e71012-f7ad-49e9-8267-20620afa12fa', '86f1d580-b172-4f25-ab1d-ba38a9eafb51', '43013b72-0c0a-4c93-9f20-f688e817d0c6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:56 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:56 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-3444d389-e927-411d-b533-6bd2b02a3b0e-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-3444d389-e927-411d-b533-6bd2b02a3b0e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-3444d389-e927-411d-b533-6bd2b02a3b0e" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-3444d389-e927-411d-b533-6bd2b02a3b0e" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0d47ca-a97e-4aab-839b-b6116fd4d007]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:57 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:57 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e Jul 08 19:49:57 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.673s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:57 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleted volume successfully. Jul 08 19:49:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23a809f9-3d14-4b3e-a603-a9da6d285c0d tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-ffb07565-6af4-457f-a6ac-fc1dcb118c59-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:57 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e" returned: 0 in 0.757s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:57 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e Jul 08 19:49:57 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:58 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3444d389-e927-411d-b533-6bd2b02a3b0e" returned: 0 in 0.658s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-3444d389-e927-411d-b533-6bd2b02a3b0e" released by "delete_volume" :: held 1.456s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['fa9b73de-659c-46d0-bd92-a3d97523d2d2', '25434b8b-de2f-4da0-ac41-f7fdba7938b0', 'ff1e8df2-5bd7-447c-9c2e-a57c08e35156', 'f5c29224-1f44-42b8-a1f0-f21f39457716'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:49:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:58 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:49:58 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-620a24e5-6cd0-402d-b164-7cb767f8cc72-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-620a24e5-6cd0-402d-b164-7cb767f8cc72-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-620a24e5-6cd0-402d-b164-7cb767f8cc72" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-620a24e5-6cd0-402d-b164-7cb767f8cc72" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:49:59 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[13788d80-0ca6-47ea-9a80-fe1a4c530736]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:49:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleted volume successfully. Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c0f51ddf-a321-4484-9c5e-ed3512e323f6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-3444d389-e927-411d-b533-6bd2b02a3b0e-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:49:59 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 Jul 08 19:49:59 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:49:59 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72" returned: 0 in 0.751s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:49:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:00 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72 Jul 08 19:50:00 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:00 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-620a24e5-6cd0-402d-b164-7cb767f8cc72" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-620a24e5-6cd0-402d-b164-7cb767f8cc72" released by "delete_volume" :: held 1.446s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['fdeb154e-ff2b-4bdf-bdab-a480c56a52db', '547164e2-5623-4a02-8bad-4cd9216a96d2', '7ad235d2-2eae-4eaa-b2d0-5f251a55b71a', '9fd6d862-ca50-4729-97ff-09befc5b7e48'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:00 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:00 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:01 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.669s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:01 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleted volume successfully. Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-97248fd7-14ed-47b6-af0f-ad37ad433814 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-620a24e5-6cd0-402d-b164-7cb767f8cc72-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0c4818-f56b-40e1-8932-14d557828d91]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:01 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c Jul 08 19:50:01 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:02 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c" returned: 0 in 0.793s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:02 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c Jul 08 19:50:02 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:02 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c" returned: 0 in 0.654s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c" released by "delete_volume" :: held 1.492s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:02 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['45d5e5b2-28b6-41fc-b5c6-edce6b09cc55', 'ddd4e052-8c6e-4814-901f-4966e0a49e55', 'b681d6f8-aadd-4632-a70e-7766c8d3b6d3', '055817c2-a8b4-47d8-bafe-106e04c56edc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:03 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:03 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-edada410-e11a-406f-b1d3-8663b2a8581a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-edada410-e11a-406f-b1d3-8663b2a8581a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-edada410-e11a-406f-b1d3-8663b2a8581a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-edada410-e11a-406f-b1d3-8663b2a8581a" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0292ae1e-b009-43a1-be45-37578350452d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:03 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.712s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleted volume successfully. Jul 08 19:50:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3797f152-ccba-4b35-acdc-1680dba5dfeb tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-8103ef1b-be33-4bb8-88bc-dfc15ffcda8c-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:03 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a Jul 08 19:50:03 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:04 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a" returned: 0 in 0.918s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:04 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a Jul 08 19:50:04 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:05 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-edada410-e11a-406f-b1d3-8663b2a8581a" returned: 0 in 0.691s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-edada410-e11a-406f-b1d3-8663b2a8581a" released by "delete_volume" :: held 1.663s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['dcd06489-1146-467e-95d6-bace189ab609', '4b341853-d161-4300-97b2-ef9c0ad0fbd4', '525d5b49-21ee-4aae-a604-5d881e02ac07', '93219fd5-85d4-4cb0-a2a1-027333a1ae32'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:05 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:05 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-e4ee6ead-8053-4ec4-8d64-9832e9ebd141-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-e4ee6ead-8053-4ec4-8d64-9832e9ebd141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-5d398451-bda9-4599-9657-854901d69268" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-5d398451-bda9-4599-9657-854901d69268" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-e4ee6ead-8053-4ec4-8d64-9832e9ebd141" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-e4ee6ead-8053-4ec4-8d64-9832e9ebd141" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleting offline snapshot e4ee6ead-8053-4ec4-8d64-9832e9ebd141 of volume 5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] snapshot_file for this snap is: volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada3ea3-92f3-45c6-88d6-3886244c210c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:06 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 Jul 08 19:50:06 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:06 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.662s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleted volume successfully. Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-82ef899c-ffc9-4df6-98cd-b13cfd1fd3e3 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-edada410-e11a-406f-b1d3-8663b2a8581a-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:06 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141" returned: 0 in 0.769s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d398451-bda9-4599-9657-854901d69268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e503d47c-7c78-4e4c-bf11-2846a0ad8287]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:06 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 Jul 08 19:50:06 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:07 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:07 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 Jul 08 19:50:07 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:08 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141" returned: 0 in 0.826s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:08 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141 Jul 08 19:50:08 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:09 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268.e4ee6ead-8053-4ec4-8d64-9832e9ebd141" returned: 0 in 0.650s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-e4ee6ead-8053-4ec4-8d64-9832e9ebd141" released by "_delete_snapshot" :: held 3.108s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-5d398451-bda9-4599-9657-854901d69268" released by "delete_snapshot" :: held 3.132s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:09 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['51aea735-c85c-4757-8568-8a1be7ef2125', '7f753e64-56cc-433c-8cbc-950ae50170b5', 'd79a828f-4278-43a1-8410-bc54d72d3cd3', '50e087ec-96b2-47b8-8417-de5d21bd5ae5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:09 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Delete snapshot completed successfully. Jul 08 19:50:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30fb9948-98e0-4224-a24a-66276c0a81e6 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-e4ee6ead-8053-4ec4-8d64-9832e9ebd141-delete_snapshot" released by "delete_snapshot" :: held 3.282s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-5d398451-bda9-4599-9657-854901d69268-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-5d398451-bda9-4599-9657-854901d69268-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "cinder-quobyte-5d398451-bda9-4599-9657-854901d69268" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-5d398451-bda9-4599-9657-854901d69268" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cb03fd-27d3-425d-bcf9-e4d0d585b4e4]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:10 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 Jul 08 19:50:10 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:11 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268" returned: 0 in 0.778s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:11 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268 Jul 08 19:50:11 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Flow 'volume_create_manager' (29f1767b-feb4-4794-ac69-6730053d840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b19bcc-dd4a-4081-868a-2454842fe2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b19bcc-dd4a-4081-868a-2454842fe2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1223289813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96460a72-dd4e-4e54-9e34-a56fac4eed7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3609928fb4584b0f9e4145c3d8ca8701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:12Z,use_quota=True,user_id='c5f3cc4e9d834cc9868e50f2eb021290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d970801-6cf1-4742-a8d4-e80068757b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d970801-6cf1-4742-a8d4-e80068757b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:11 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6081486f-6c50-4afc-82d7-212aa9fc50a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6081486f-6c50-4afc-82d7-212aa9fc50a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96460a72-dd4e-4e54-9e34-a56fac4eed7b', 'volume_name': 'volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95367a3e-37e5-41ed-a39f-676315d60817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95367a3e-37e5-41ed-a39f-676315d60817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525f19b8-1a31-4bb9-854a-c45ea6c6466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:11 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Volume 96460a72-dd4e-4e54-9e34-a56fac4eed7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b', 'volume_size': 1} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1223289813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96460a72-dd4e-4e54-9e34-a56fac4eed7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3609928fb4584b0f9e4145c3d8ca8701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:12Z,use_quota=True,user_id='c5f3cc4e9d834cc9868e50f2eb021290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Creating volume 96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:11 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5d398451-bda9-4599-9657-854901d69268" returned: 0 in 0.670s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:11 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b 1073741824 Jul 08 19:50:11 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-quobyte-5d398451-bda9-4599-9657-854901d69268" released by "delete_volume" :: held 1.520s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Created reservations ['4f63546a-bfde-41e6-a699-d62d031fc180', '873a1279-3e19-4539-966d-db723750748a', '263d1027-2979-4d4f-be04-c7257346174f', '36f708cb-8425-408c-90df-8fb8dc494526'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:11 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:11 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:12 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.629s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:12 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Deleted volume successfully. Jul 08 19:50:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1f02148-fa4c-4ea1-8aad-365d64a05329 tempest-CreateVolumesFromSnapshotTest-1841134457 None] Lock "cinder-5d398451-bda9-4599-9657-854901d69268-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:12 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b 1073741824" returned: 0 in 0.845s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:12 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:12 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:13 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.644s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525f19b8-1a31-4bb9-854a-c45ea6c6466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03831082-e648-4a76-b02a-b623ec8c2790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:13 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Volume volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b (96460a72-dd4e-4e54-9e34-a56fac4eed7b): created successfully Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03831082-e648-4a76-b02a-b623ec8c2790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Flow 'volume_create_manager' (29f1767b-feb4-4794-ac69-6730053d840a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:13 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0d9da9b9-8687-4336-857f-b4841a980f31 tempest-VolumeDependencyTests-1762048185 None] Created volume successfully. Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=98,cinder:UPDATE=138,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Creating offline snapshot 8e0ad459-9ef8-4590-b2b7-e746cba620c2 of volume 96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af11ad2-b2b0-4941-8c18-6a266ac1996b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:14 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:14 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:14 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.823s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:14 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 1G Jul 08 19:50:14 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:15 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 1G" returned: 0 in 0.823s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:15 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 Jul 08 19:50:15 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:16 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2" returned: 0 in 0.686s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:16 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 is being set with open permissions: ugo+rw Jul 08 19:50:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:16 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 Jul 08 19:50:16 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:16 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2" returned: 0 in 0.637s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:16 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=93,cinder:UPDATE=141,cinder:DELETE=17,cinder:INSERT=35 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:50:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:16 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info Jul 08 19:50:16 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:17 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info" returned: 0 in 0.646s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:17 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info is being set with open permissions: ugo+rw Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:17 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info Jul 08 19:50:17 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Flow 'volume_create_manager' (9e96ed24-7315-4067-b131-dee2ec3ea985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff303df-99d6-43de-976e-3079aff26b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff303df-99d6-43de-976e-3079aff26b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc2740b-87b0-43cf-85ad-a02e0912c4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e414a943c0794935a63189f357e4f3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:18Z,use_quota=True,user_id='ff3f0d36fd8649c194f5260f55cf1f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba408a0-4d69-41b6-88a1-97a5ffef7ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba408a0-4d69-41b6-88a1-97a5ffef7ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee07c852-8233-4e7f-ac76-ac53173c50f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee07c852-8233-4e7f-ac76-ac53173c50f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dc2740b-87b0-43cf-85ad-a02e0912c4ee', 'volume_name': 'volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee', 'volume_size': 1, 'image_id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e19f4ee204cb3fc487f6432762faf262', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e414a943c0794935a63189f357e4f3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3e8ede7289ee2d517f38a9b446c155c10b723a3c37427aa60a95b102148c0aa69ebc3bdcbf4dbd77a7ab022fe9cce2b4c135924f51af23e8e7d8be86135bcc1', 'id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'created_at': datetime.datetime(2026, 7, 8, 17, 50, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 50, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442/file', 'properties': {}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b7c07c-2e7a-4aa2-8edd-0e3e4a24662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b7c07c-2e7a-4aa2-8edd-0e3e4a24662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f141845-ec9e-48a9-a38d-bd39d556d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Volume 7dc2740b-87b0-43cf-85ad-a02e0912c4ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee', 'volume_size': 1, 'image_id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e19f4ee204cb3fc487f6432762faf262', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e414a943c0794935a63189f357e4f3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3e8ede7289ee2d517f38a9b446c155c10b723a3c37427aa60a95b102148c0aa69ebc3bdcbf4dbd77a7ab022fe9cce2b4c135924f51af23e8e7d8be86135bcc1', 'id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'created_at': datetime.datetime(2026, 7, 8, 17, 50, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 50, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442/file', 'properties': {}}, 'image_service': } Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Trying to clone 7dc2740b-87b0-43cf-85ad-a02e0912c4ee from image b2834ac3-2eb7-4d2e-8a48-895dd4635442 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:50:17 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:50:17 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Image download 0.00 MB at 0.00 MB/s Jul 08 19:50:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aed97b-66c4-4953-848a-91f0c88faf8d]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:18 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD Jul 08 19:50:18 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:18 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.info" returned: 0 in 0.636s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-62b3c5e1-884a-4e0d-9215-d6f31b843e5e tempest-VolumeDependencyTests-1762048185 None] Create snapshot completed successfully Jul 08 19:50:18 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:18 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD Jul 08 19:50:18 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:19 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD" returned: 1 in 0.765s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Temporary image b2834ac3-2eb7-4d2e-8a48-895dd4635442 is fetched for user ff3f0d36fd8649c194f5260f55cf1f35. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Flow 'volume_create_manager' (044392db-12ae-449c-98d2-cc3c242c34ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e8200-ff69-477d-9dad-9c9c761472ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716e8200-ff69-477d-9dad-9c9c761472ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1193106225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628f55ad-40e7-4508-8d59-0bb3395fe2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3609928fb4584b0f9e4145c3d8ca8701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e0ad459-9ef8-4590-b2b7-e746cba620c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:20Z,use_quota=True,user_id='c5f3cc4e9d834cc9868e50f2eb021290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcbd1ae-272a-4423-a73a-4a662ca3fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dcbd1ae-272a-4423-a73a-4a662ca3fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cd796c-c099-48b7-bdf7-a7f39234129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cd796c-c099-48b7-bdf7-a7f39234129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '628f55ad-40e7-4508-8d59-0bb3395fe2b8', 'volume_name': 'volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8', 'volume_size': 1, 'snapshot_id': '8e0ad459-9ef8-4590-b2b7-e746cba620c2'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6e6e1c-928e-4e7a-8545-239484c277d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6e6e1c-928e-4e7a-8545-239484c277d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeca1bf-35cf-4832-988e-ff5f41a861cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:19 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Volume 628f55ad-40e7-4508-8d59-0bb3395fe2b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8', 'volume_size': 1, 'snapshot_id': '8e0ad459-9ef8-4590-b2b7-e746cba620c2'} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-quobyte-8e0ad459-9ef8-4590-b2b7-e746cba620c2-628f55ad-40e7-4508-8d59-0bb3395fe2b8" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b565df-2cef-49dc-941d-8d8ef2cc80fa]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-8e0ad459-9ef8-4590-b2b7-e746cba620c2-628f55ad-40e7-4508-8d59-0bb3395fe2b8" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Creating volume 628f55ad-40e7-4508-8d59-0bb3395fe2b8 from snapshot 8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-quobyte-628f55ad-40e7-4508-8d59-0bb3395fe2b8" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-628f55ad-40e7-4508-8d59-0bb3395fe2b8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] snapshot: 8e0ad459-9ef8-4590-b2b7-e746cba620c2, volume: 628f55ad-40e7-4508-8d59-0bb3395fe2b8, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb07bf5-0ea2-4417-ab08-affe63af47be]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:19 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD Jul 08 19:50:19 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:19 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 Jul 08 19:50:19 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:20 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:20 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD Jul 08 19:50:20 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:20 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2" returned: 0 in 0.858s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda1ad08-c2f8-4633-aab3-02c40126c0ff]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:20 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:20 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:21 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD" returned: 1 in 0.785s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:50:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:21 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.741s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:21 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:50:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:21 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 Jul 08 19:50:21 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:25 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8" returned: 0 in 4.389s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:25 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[03387974-28fc-49de-b06f-8829ceb18287]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:25 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:25 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:26 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.945s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:26 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:50:26 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Converted 1024.00 MB image at 233.26 MB/s Jul 08 19:50:26 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 is being set with open permissions: ugo+rw Jul 08 19:50:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:26 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 Jul 08 19:50:26 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:27 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8" returned: 0 in 0.681s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-628f55ad-40e7-4508-8d59-0bb3395fe2b8" released by "_copy_volume_from_snapshot" :: held 7.717s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-8e0ad459-9ef8-4590-b2b7-e746cba620c2-628f55ad-40e7-4508-8d59-0bb3395fe2b8" released by "_create_volume_from_snapshot" :: held 7.750s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.781s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc2740b-87b0-43cf-85ad-a02e0912c4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e414a943c0794935a63189f357e4f3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:18Z,use_quota=True,user_id='ff3f0d36fd8649c194f5260f55cf1f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Creating volume 7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:27 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:27 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee 1073741824 Jul 08 19:50:27 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeca1bf-35cf-4832-988e-ff5f41a861cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8', 'volume_size': 1, 'snapshot_id': '8e0ad459-9ef8-4590-b2b7-e746cba620c2'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c258fe3-b185-49d8-987b-da92a0608fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Volume volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 (628f55ad-40e7-4508-8d59-0bb3395fe2b8): created successfully Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c258fe3-b185-49d8-987b-da92a0608fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Flow 'volume_create_manager' (044392db-12ae-449c-98d2-cc3c242c34ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f7110cc4-b77a-4734-b629-f0450143b10f tempest-VolumeDependencyTests-1762048185 None] Created volume successfully. Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-8e0ad459-9ef8-4590-b2b7-e746cba620c2-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-8e0ad459-9ef8-4590-b2b7-e746cba620c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-quobyte-96460a72-dd4e-4e54-9e34-a56fac4eed7b" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-96460a72-dd4e-4e54-9e34-a56fac4eed7b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-quobyte-8e0ad459-9ef8-4590-b2b7-e746cba620c2" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-8e0ad459-9ef8-4590-b2b7-e746cba620c2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Deleting offline snapshot 8e0ad459-9ef8-4590-b2b7-e746cba620c2 of volume 96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] snapshot_file for this snap is: volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a0f0a-b520-4f0d-bad6-9b1536f2900c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:28 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee 1073741824" returned: 0 in 0.832s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:28 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:28 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:28 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 Jul 08 19:50:28 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:28 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:29 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2" returned: 0 in 0.748s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Attempting download of b2834ac3-2eb7-4d2e-8a48-895dd4635442 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'metadata': {}}])) to volume 7dc2740b-87b0-43cf-85ad-a02e0912c4ee. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06f0bf-2492-446f-aea2-b6a69d048976]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[920c655a-2c42-46c4-b5b1-20ee33a64744]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:29 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:29 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:29 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n Jul 08 19:50:29 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:29 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n" returned: 0 in 0.755s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:29 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:29 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 Jul 08 19:50:29 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:29 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n Jul 08 19:50:29 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:30 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n" returned: 1 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2834ac3-2eb7-4d2e-8a48-895dd4635442_g2xif_3n' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:50:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd62c3-cbe0-42ec-a125-a4cba10a453f]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:30 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2" returned: 0 in 0.732s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:30 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2 Jul 08 19:50:30 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:30 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD Jul 08 19:50:30 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:31 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b.8e0ad459-9ef8-4590-b2b7-e746cba620c2" returned: 0 in 0.638s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-8e0ad459-9ef8-4590-b2b7-e746cba620c2" released by "_delete_snapshot" :: held 3.041s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-96460a72-dd4e-4e54-9e34-a56fac4eed7b" released by "delete_snapshot" :: held 3.064s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Created reservations ['26acf852-89fe-4f6a-aa9c-4f1cc2eab66c', '36305ce2-cee7-4681-aaeb-d1419ad9e439', '02b4935f-dd22-4a19-a28d-1c1915c7e03d', '7c5f1d12-c4b5-46b9-b072-dcb647938834'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:31 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:31 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Delete snapshot completed successfully. Jul 08 19:50:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-08ce08a1-e3f8-4ec1-ad43-0f08664f3bec tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-8e0ad459-9ef8-4590-b2b7-e746cba620c2-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:31 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD Jul 08 19:50:31 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:32 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD" returned: 1 in 0.697s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] b2834ac3-2eb7-4d2e-8a48-895dd4635442 was raw, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:32 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:32 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-96460a72-dd4e-4e54-9e34-a56fac4eed7b-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-96460a72-dd4e-4e54-9e34-a56fac4eed7b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-quobyte-96460a72-dd4e-4e54-9e34-a56fac4eed7b" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-96460a72-dd4e-4e54-9e34-a56fac4eed7b" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b01508c-6fde-471a-9185-d8c8f97c69ef]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:32 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:32 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:32 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 0 in 0.763s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2834ac3-2eb7-4d2e-8a48-895dd4635442_clge994odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:50:32 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 19:50:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:32 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee 1G Jul 08 19:50:32 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:33 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.743s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:33 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b Jul 08 19:50:33 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:33 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee 1G" returned: 0 in 0.682s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f9b9d-58a0-450b-a01e-dab73267f469]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:33 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:33 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:33 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-96460a72-dd4e-4e54-9e34-a56fac4eed7b" returned: 0 in 0.634s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-96460a72-dd4e-4e54-9e34-a56fac4eed7b" released by "delete_volume" :: held 1.432s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Created reservations ['c24c05fb-e870-4e8c-9b79-ed5523d2c474', 'e5d1bfd8-daf2-4a7d-bdb4-e0f45e83d1ed', 'e58fc1c0-0743-49dc-8535-791744eeca0d', '779dfebc-5a09-42e9-aa0e-6ece3231d564'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:34 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:34 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:34 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 0 in 0.800s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:34 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:34 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-628f55ad-40e7-4508-8d59-0bb3395fe2b8-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:34 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:34 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:34 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.687s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-628f55ad-40e7-4508-8d59-0bb3395fe2b8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Deleted volume successfully. Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-47213ca9-3619-4d6c-b234-68164c0e8635 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-96460a72-dd4e-4e54-9e34-a56fac4eed7b-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "cinder-quobyte-628f55ad-40e7-4508-8d59-0bb3395fe2b8" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-628f55ad-40e7-4508-8d59-0bb3395fe2b8" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eee4aa-c779-4497-99cc-0a81c3cd8510]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:35 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 Jul 08 19:50:35 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:35 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 1 in 0.833s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Downloaded image b2834ac3-2eb7-4d2e-8a48-895dd4635442 ((None, [{'url': 'file:///opt/stack/data/glance/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'metadata': {}}])) to volume 7dc2740b-87b0-43cf-85ad-a02e0912c4ee successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Temporary image b2834ac3-2eb7-4d2e-8a48-895dd4635442 for user ff3f0d36fd8649c194f5260f55cf1f35 is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Marking volume 7dc2740b-87b0-43cf-85ad-a02e0912c4ee as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Copying metadata from image b2834ac3-2eb7-4d2e-8a48-895dd4635442 to 7dc2740b-87b0-43cf-85ad-a02e0912c4ee. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Creating volume glance metadata for volume 7dc2740b-87b0-43cf-85ad-a02e0912c4ee backed by image b2834ac3-2eb7-4d2e-8a48-895dd4635442 with: {'image_id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e19f4ee204cb3fc487f6432762faf262', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f141845-ec9e-48a9-a38d-bd39d556d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee', 'volume_size': 1, 'image_id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e19f4ee204cb3fc487f6432762faf262', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e414a943c0794935a63189f357e4f3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3e8ede7289ee2d517f38a9b446c155c10b723a3c37427aa60a95b102148c0aa69ebc3bdcbf4dbd77a7ab022fe9cce2b4c135924f51af23e8e7d8be86135bcc1', 'id': 'b2834ac3-2eb7-4d2e-8a48-895dd4635442', 'created_at': datetime.datetime(2026, 7, 8, 17, 50, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 50, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2834ac3-2eb7-4d2e-8a48-895dd4635442/file', 'properties': {}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a64f2a-23ae-471b-a58a-dff00afc5e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:35 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Volume volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee (7dc2740b-87b0-43cf-85ad-a02e0912c4ee): created successfully Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a64f2a-23ae-471b-a58a-dff00afc5e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Flow 'volume_create_manager' (9e96ed24-7315-4067-b131-dee2ec3ea985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:35 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-cfa3cd2f-512d-4565-bbf5-cc2f91bc6e3c tempest-VolumeImageDependencyTests-2075220034 None] Created volume successfully. Jul 08 19:50:35 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.873s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:50:35 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8" returned: 0 in 0.773s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:35 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8 Jul 08 19:50:35 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Acquiring lock "cinder-7dc2740b-87b0-43cf-85ad-a02e0912c4ee-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Lock "cinder-7dc2740b-87b0-43cf-85ad-a02e0912c4ee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Acquiring lock "cinder-quobyte-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Lock "cinder-quobyte-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3885fad9-ed66-4caf-be28-37e59e466e56]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:36 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:36 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:36 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-628f55ad-40e7-4508-8d59-0bb3395fe2b8" returned: 0 in 0.672s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-quobyte-628f55ad-40e7-4508-8d59-0bb3395fe2b8" released by "delete_volume" :: held 1.498s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Created reservations ['620706d7-fb6f-4bec-b1ec-067ba2f5463a', 'fcf5c069-6195-4350-adf3-d3c71507cfd2', 'ed38c35a-0527-4846-b629-c35d6458b64a', '98e08e56-8791-4336-beb7-4524196d0f4d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:36 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:36 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:36 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 0 in 0.744s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:36 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:36 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:37 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.635s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:37 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:37 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Deleted volume successfully. Jul 08 19:50:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7894bc85-ea08-4075-ae4e-550f04fab400 tempest-VolumeDependencyTests-1762048185 None] Lock "cinder-628f55ad-40e7-4508-8d59-0bb3395fe2b8-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:37 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 1 in 0.760s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:50:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:37 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee Jul 08 19:50:37 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:38 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" returned: 0 in 0.697s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Lock "cinder-quobyte-7dc2740b-87b0-43cf-85ad-a02e0912c4ee" released by "delete_volume" :: held 2.269s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Created reservations ['c5dc3d77-ef0d-40c1-b092-17746ad5c246', 'a6473f62-9c80-426f-9885-3f22bfc9da1f', '6b9e3d98-ac24-4cd9-93ad-88b14131e664', 'db51aafc-ac7f-4f47-969b-639dc136c79e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:38 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:38 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:39 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.718s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Deleted volume successfully. Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ebe6f2e2-96d2-4758-ba96-553edc8bf5c3 tempest-VolumeImageDependencyTests-2075220034 None] Lock "cinder-7dc2740b-87b0-43cf-85ad-a02e0912c4ee-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Flow 'volume_create_manager' (4d58a0bf-6e24-4f8f-9ac2-3efec59fd749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc29d43-91a9-4157-a0a4-5c01e8d3e912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc29d43-91a9-4157-a0a4-5c01e8d3e912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f2b997-d32c-4b57-9219-61872d91d2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6804fbf7e7432cb10024bbac9a35d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:40Z,use_quota=True,user_id='ee44f677d0a740c08253450a4b433573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ec4021-f10c-459e-8ad4-0d0e84fbeac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ec4021-f10c-459e-8ad4-0d0e84fbeac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1ff1d-6b99-47c1-badd-8377a16e2bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1ff1d-6b99-47c1-badd-8377a16e2bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f2b997-d32c-4b57-9219-61872d91d2d5', 'volume_name': 'volume-b3f2b997-d32c-4b57-9219-61872d91d2d5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269a2d1d-3cc3-4a28-859c-7b7f2488d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269a2d1d-3cc3-4a28-859c-7b7f2488d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ee9c73-7572-4a72-ba4c-a60deeb2146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:39 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Volume b3f2b997-d32c-4b57-9219-61872d91d2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f2b997-d32c-4b57-9219-61872d91d2d5', 'volume_size': 1} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f2b997-d32c-4b57-9219-61872d91d2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6804fbf7e7432cb10024bbac9a35d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:40Z,use_quota=True,user_id='ee44f677d0a740c08253450a4b433573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Creating volume b3f2b997-d32c-4b57-9219-61872d91d2d5 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:40 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:40 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 1073741824 Jul 08 19:50:40 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:40 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 1073741824" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:40 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 Jul 08 19:50:40 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:41 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5" returned: 0 in 0.664s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ee9c73-7572-4a72-ba4c-a60deeb2146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f2b997-d32c-4b57-9219-61872d91d2d5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef3a4f2-d5fe-4010-b73e-33c28dcf8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Volume volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 (b3f2b997-d32c-4b57-9219-61872d91d2d5): created successfully Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef3a4f2-d5fe-4010-b73e-33c28dcf8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Flow 'volume_create_manager' (4d58a0bf-6e24-4f8f-9ac2-3efec59fd749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b66066f3-60fb-4b73-a44d-d210fccb0566 tempest-CinderUnicodeTest-823566915 None] Created volume successfully. Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Flow 'volume_create_manager' (a2eac719-8894-4af0-80a3-07464c40ea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738a69ac-e46d-47d5-a796-e6d3e26c2204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738a69ac-e46d-47d5-a796-e6d3e26c2204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1708555183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4850943-76cd-45eb-98fd-c30fb958d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6804fbf7e7432cb10024bbac9a35d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:42Z,use_quota=True,user_id='ee44f677d0a740c08253450a4b433573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e8ad41-0783-46f5-8875-1ddb1d80d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e8ad41-0783-46f5-8875-1ddb1d80d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cefdb7-aef0-4cdb-b67f-871e87812bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cefdb7-aef0-4cdb-b67f-871e87812bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4850943-76cd-45eb-98fd-c30fb958d9ca', 'volume_name': 'volume-c4850943-76cd-45eb-98fd-c30fb958d9ca', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f231b479-524e-4807-a60f-3a99431f1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f231b479-524e-4807-a60f-3a99431f1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430ee109-5436-4afa-b1b6-76f0cae460ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:42 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Volume c4850943-76cd-45eb-98fd-c30fb958d9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4850943-76cd-45eb-98fd-c30fb958d9ca', 'volume_size': 1} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1708555183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4850943-76cd-45eb-98fd-c30fb958d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a6804fbf7e7432cb10024bbac9a35d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:42Z,use_quota=True,user_id='ee44f677d0a740c08253450a4b433573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Creating volume c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:42 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:42 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca 1073741824 Jul 08 19:50:42 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:43 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca 1073741824" returned: 0 in 0.836s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:43 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca Jul 08 19:50:43 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:44 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca" returned: 0 in 0.661s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430ee109-5436-4afa-b1b6-76f0cae460ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4850943-76cd-45eb-98fd-c30fb958d9ca', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0097312-b4b1-4122-9aa8-9ee2401a459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Volume volume-c4850943-76cd-45eb-98fd-c30fb958d9ca (c4850943-76cd-45eb-98fd-c30fb958d9ca): created successfully Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0097312-b4b1-4122-9aa8-9ee2401a459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Flow 'volume_create_manager' (a2eac719-8894-4af0-80a3-07464c40ea18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c30ed4ce-b9f8-45b4-a4de-c2506f203d97 tempest-CinderUnicodeTest-823566915 None] Created volume successfully. Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Creating offline snapshot 22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce of volume c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d916ae0c-b3a7-4c80-a0dd-a72c1ed0d24f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:44 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca Jul 08 19:50:44 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:45 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca" returned: 0 in 0.867s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:45 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce 1G Jul 08 19:50:45 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:46 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce 1G" returned: 0 in 0.864s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4850943-76cd-45eb-98fd-c30fb958d9ca -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:46 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4850943-76cd-45eb-98fd-c30fb958d9ca -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce Jul 08 19:50:46 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:47 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4850943-76cd-45eb-98fd-c30fb958d9ca -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" returned: 0 in 0.699s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:47 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce is being set with open permissions: ugo+rw Jul 08 19:50:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:47 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce Jul 08 19:50:47 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:47 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" returned: 0 in 0.624s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:47 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:48 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info Jul 08 19:50:48 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (feea1101-abce-4ae7-b6f0-f13c3b7eedba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51663fff-3ae5-4c5f-85c0-c9e35eb5b38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51663fff-3ae5-4c5f-85c0-c9e35eb5b38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1549160080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21db9a1-1f3a-4c5f-80bc-809b78fa27a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:48Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec10e6a-d7cb-4dce-a243-40ca88701b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec10e6a-d7cb-4dce-a243-40ca88701b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fed2b4e-1d3c-45b6-8ea1-578eaaeb5d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fed2b4e-1d3c-45b6-8ea1-578eaaeb5d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21db9a1-1f3a-4c5f-80bc-809b78fa27a0', 'volume_name': 'volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861fa768-0fc0-4230-b7c6-754deac2939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861fa768-0fc0-4230-b7c6-754deac2939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab407c7-40ec-4f2b-9478-ff2b543a5de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:48 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Volume b21db9a1-1f3a-4c5f-80bc-809b78fa27a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0', 'volume_size': 1} Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:48 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info" returned: 0 in 0.630s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:48 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info is being set with open permissions: ugo+rw Jul 08 19:50:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:48 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info Jul 08 19:50:48 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:49 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.info" returned: 0 in 0.686s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.474s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1549160080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21db9a1-1f3a-4c5f-80bc-809b78fa27a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:48Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Creating volume b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:49 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:49 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 1073741824 Jul 08 19:50:49 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f7e4b86e-ee3a-4778-86f9-53e80a596292 tempest-CinderUnicodeTest-823566915 None] Create snapshot completed successfully Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-quobyte-c4850943-76cd-45eb-98fd-c30fb958d9ca" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:50 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 1073741824" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-c4850943-76cd-45eb-98fd-c30fb958d9ca" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-quobyte-22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Deleting offline snapshot 22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce of volume c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] snapshot_file for this snap is: volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c095a5e0-10df-4ce2-bad3-67950aff4b41]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:50 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 Jul 08 19:50:50 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:50 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce Jul 08 19:50:50 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:50 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab407c7-40ec-4f2b-9478-ff2b543a5de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1a9923-dbcb-47a9-b284-a27a0dd8bdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:50 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Volume volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 (b21db9a1-1f3a-4c5f-80bc-809b78fa27a0): created successfully Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1a9923-dbcb-47a9-b284-a27a0dd8bdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (feea1101-abce-4ae7-b6f0-f13c3b7eedba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:50 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d02a35b0-64ac-4ce1-bf33-41d35805d200 tempest-ProjectReaderTests-1415224800 None] Created volume successfully. Jul 08 19:50:50 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" returned: 0 in 0.791s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4850943-76cd-45eb-98fd-c30fb958d9ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[210cf28f-5ac5-465c-bf04-1c67ffef8a8b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:51 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca Jul 08 19:50:51 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-quobyte-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d9a9a-daa8-4346-a26e-4eb5cd7cb495]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:51 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 Jul 08 19:50:51 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:51 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:51 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce Jul 08 19:50:51 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:52 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:52 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0 Jul 08 19:50:52 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:52 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" returned: 0 in 0.759s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:52 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce Jul 08 19:50:52 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:52 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0" returned: 0 in 0.686s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0" released by "delete_volume" :: held 1.530s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Created reservations ['fb9e9edd-557d-4390-827d-482fccc3ac52', '2c1cefb1-27c0-44f2-8c81-fb60659aafc0', '72eef81e-ce8d-41f1-be77-ad7082f689ff', 'e01adc99-0421-448d-9382-97dbc46f35d7'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:52 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:52 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:53 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca.22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" returned: 0 in 0.638s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce" released by "_delete_snapshot" :: held 3.045s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-c4850943-76cd-45eb-98fd-c30fb958d9ca" released by "delete_snapshot" :: held 3.076s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Created reservations ['d16166bb-2172-4127-a432-717790383b0f', '6adaa518-70c7-402a-bd7d-991388448c98', '3874b8a3-175a-4a7f-9178-220ad1aaa482', 'd941a3ab-fee1-47a9-8ac9-9449f37dee8f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Delete snapshot completed successfully. Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-254460f3-5f64-4406-b1aa-87a1e1791db4 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-22a0ecd0-1b0c-4dbc-89ba-204bcc5ed0ce-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:53 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.653s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Deleted volume successfully. Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80213487-6aad-456a-a6d8-d6aa94882687 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-b21db9a1-1f3a-4c5f-80bc-809b78fa27a0-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (0c7cc71d-8a54-4b59-bb05-2793974b6b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804c2394-505f-437b-a410-590be21df2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804c2394-505f-437b-a410-590be21df2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389210123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c2b68f-82ad-44fd-afc2-9c3ed668e54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:54Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a35705f-ad69-45c3-a0fe-93f22c49e46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a35705f-ad69-45c3-a0fe-93f22c49e46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df49b79-b9d5-4ec8-ade5-ee1ce4651c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df49b79-b9d5-4ec8-ade5-ee1ce4651c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c2b68f-82ad-44fd-afc2-9c3ed668e54a', 'volume_name': 'volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a904914-03ba-4b3c-983e-1d3d8de8fe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a904914-03ba-4b3c-983e-1d3d8de8fe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad77b4ac-ad01-4121-a59b-69f9741134c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Volume e9c2b68f-82ad-44fd-afc2-9c3ed668e54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a', 'volume_size': 1} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389210123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c2b68f-82ad-44fd-afc2-9c3ed668e54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:54Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Creating volume e9c2b68f-82ad-44fd-afc2-9c3ed668e54a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:53 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:53 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a 1073741824 Jul 08 19:50:53 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-c4850943-76cd-45eb-98fd-c30fb958d9ca-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-c4850943-76cd-45eb-98fd-c30fb958d9ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-quobyte-c4850943-76cd-45eb-98fd-c30fb958d9ca" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-c4850943-76cd-45eb-98fd-c30fb958d9ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c1d2b2-9f62-484b-98e3-f2225d2c359d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:54 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca Jul 08 19:50:54 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:54 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a 1073741824" returned: 0 in 0.824s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:54 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a Jul 08 19:50:54 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:55 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca" returned: 0 in 0.753s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:55 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca Jul 08 19:50:55 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:55 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a" returned: 0 in 0.661s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad77b4ac-ad01-4121-a59b-69f9741134c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298c2d5b-1b94-4c78-adcc-f558513dc211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:55 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Volume volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a (e9c2b68f-82ad-44fd-afc2-9c3ed668e54a): created successfully Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298c2d5b-1b94-4c78-adcc-f558513dc211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (0c7cc71d-8a54-4b59-bb05-2793974b6b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:55 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b34c4917-8a06-42ca-b017-c57022cc6d3c tempest-ProjectReaderTests-1415224800 None] Created volume successfully. Jul 08 19:50:55 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4850943-76cd-45eb-98fd-c30fb958d9ca" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-c4850943-76cd-45eb-98fd-c30fb958d9ca" released by "delete_volume" :: held 1.454s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Created reservations ['abc52531-a544-4644-b993-a4501be98620', '9f2eea0e-db19-4ebf-b6c7-c0a25ca52aa7', '3bcfa99a-1e36-49bf-b667-62272b111c49', 'c6fc0e94-9ba1-401c-80b9-98238d54b54c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:56 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:56 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-quobyte-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee0830-57a0-4f24-afbe-0d629f48e07f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:56 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a Jul 08 19:50:56 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-b3f2b997-d32c-4b57-9219-61872d91d2d5-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:56 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-b3f2b997-d32c-4b57-9219-61872d91d2d5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:56 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Deleted volume successfully. Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-649adc59-4d3c-4915-81ad-f49d93fa1ff0 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-c4850943-76cd-45eb-98fd-c30fb958d9ca-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "cinder-quobyte-b3f2b997-d32c-4b57-9219-61872d91d2d5" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-b3f2b997-d32c-4b57-9219-61872d91d2d5" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[44224d62-1172-47ca-be1d-20e1ebfefd9d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:56 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 Jul 08 19:50:56 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:56 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a" returned: 0 in 0.801s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:56 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a Jul 08 19:50:56 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:57 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5" returned: 0 in 0.715s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:57 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5 Jul 08 19:50:57 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:57 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a" released by "delete_volume" :: held 1.488s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Created reservations ['16f5c61c-ace6-4339-825f-cac612db8b7d', '961b6819-88f5-48aa-8e40-1c4100c8bfe8', 'fb5118e0-37ae-4018-9cf8-4e8b032bea99', 'c9dd9deb-064e-4703-9f21-b0938f6c68ac'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:57 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:57 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:58 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b3f2b997-d32c-4b57-9219-61872d91d2d5" returned: 0 in 0.617s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-quobyte-b3f2b997-d32c-4b57-9219-61872d91d2d5" released by "delete_volume" :: held 1.372s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Created reservations ['d75ff949-a662-4ac5-8611-bcac1285ab53', '14e458ce-5752-4d92-aa73-aff140bd7346', 'bd1460de-e5c4-420f-8728-c1e5778d711c', '1aea80b6-a3a1-4650-98c9-727813af9201'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:58 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:50:58 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:58 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.697s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Deleted volume successfully. Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8b8e46c4-d2aa-4c36-b616-f4019591abf7 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-e9c2b68f-82ad-44fd-afc2-9c3ed668e54a-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (3be1fd66-73ea-4c8b-ae43-a4304d39768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3312bb2b-615a-4abf-a0a2-4949654f2c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3312bb2b-615a-4abf-a0a2-4949654f2c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805662886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1522510-244d-4e76-a49f-5d9d74fcd67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:59Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd5e430-4c6c-4aef-8301-15d6981d1ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd5e430-4c6c-4aef-8301-15d6981d1ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141d6aef-f5fb-447a-b5ed-fcc49d739b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141d6aef-f5fb-447a-b5ed-fcc49d739b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1522510-244d-4e76-a49f-5d9d74fcd67d', 'volume_name': 'volume-a1522510-244d-4e76-a49f-5d9d74fcd67d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bff68ba-3d42-4dcc-a448-965fddaf3276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bff68ba-3d42-4dcc-a448-965fddaf3276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f850834f-58e0-4ed5-b9de-c86f3c384791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:50:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Volume a1522510-244d-4e76-a49f-5d9d74fcd67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1522510-244d-4e76-a49f-5d9d74fcd67d', 'volume_size': 1} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:50:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805662886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1522510-244d-4e76-a49f-5d9d74fcd67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:50:59Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Creating volume a1522510-244d-4e76-a49f-5d9d74fcd67d {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:50:58 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:58 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d 1073741824 Jul 08 19:50:58 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:50:58 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.678s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:50:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Deleted volume successfully. Jul 08 19:50:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f0274a92-2ca3-4ea5-9c04-129e1613b234 tempest-CinderUnicodeTest-823566915 None] Lock "cinder-b3f2b997-d32c-4b57-9219-61872d91d2d5-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:50:59 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 08 19:50:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d 1073741824" returned: 0 in 0.923s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:50:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:50:59 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d Jul 08 19:50:59 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:00 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d" returned: 0 in 0.659s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f850834f-58e0-4ed5-b9de-c86f3c384791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1522510-244d-4e76-a49f-5d9d74fcd67d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd548b2f-c57e-4703-818d-1bf07cd31a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Volume volume-a1522510-244d-4e76-a49f-5d9d74fcd67d (a1522510-244d-4e76-a49f-5d9d74fcd67d): created successfully Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd548b2f-c57e-4703-818d-1bf07cd31a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (3be1fd66-73ea-4c8b-ae43-a4304d39768e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a3572bec-18a1-4318-88a2-3bdb4008a934 tempest-ProjectReaderTests-1415224800 None] Created volume successfully. Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-a1522510-244d-4e76-a49f-5d9d74fcd67d-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-a1522510-244d-4e76-a49f-5d9d74fcd67d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-quobyte-a1522510-244d-4e76-a49f-5d9d74fcd67d" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-a1522510-244d-4e76-a49f-5d9d74fcd67d" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e048dd8e-b572-461d-bfe8-198903749101]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:01 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d Jul 08 19:51:01 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:01 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d" returned: 0 in 0.767s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:01 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d Jul 08 19:51:01 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:02 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-a1522510-244d-4e76-a49f-5d9d74fcd67d" returned: 0 in 0.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-a1522510-244d-4e76-a49f-5d9d74fcd67d" released by "delete_volume" :: held 1.453s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Created reservations ['1a4720bc-aadc-4f8e-9221-0f49af679412', '885b5929-2a50-4e2a-bd72-adc6393756d3', '74c21bb1-13ed-468e-8a48-0155cbdfbd0b', 'c6199588-c93c-40c3-a8ab-a69bd059576f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:02 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:51:02 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:03 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.644s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:51:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Deleted volume successfully. Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ad4bbdcb-b316-4680-81db-5233289ee0d8 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-a1522510-244d-4e76-a49f-5d9d74fcd67d-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (a87f2e54-717a-469d-a08e-a6c436831eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ff7ecb-6a18-4d15-83a6-ca9baebe9e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ff7ecb-6a18-4d15-83a6-ca9baebe9e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697243813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ae3e8c-ed98-424d-8ce6-a6be50102fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:51:04Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ae9954-99f1-4e97-9690-a757db0d2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ae9954-99f1-4e97-9690-a757db0d2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cc28f6-aa30-4528-9883-47a64a75c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cc28f6-aa30-4528-9883-47a64a75c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ae3e8c-ed98-424d-8ce6-a6be50102fe9', 'volume_name': 'volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2341cd-de9f-4896-b999-91abf0bbbda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2341cd-de9f-4896-b999-91abf0bbbda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee1003f-d8fb-493a-bfa8-6e56b893e045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:03 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Volume d8ae3e8c-ed98-424d-8ce6-a6be50102fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9', 'volume_size': 1} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697243813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ae3e8c-ed98-424d-8ce6-a6be50102fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed29e5530dd44377b6c5424536d445c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:51:04Z,use_quota=True,user_id='95b3fa8619ff4911a7e7d29afc464413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Creating volume d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:51:03 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:51:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:03 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 1073741824 Jul 08 19:51:03 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:04 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 1073741824" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:04 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 Jul 08 19:51:04 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:05 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9" returned: 0 in 0.641s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee1003f-d8fb-493a-bfa8-6e56b893e045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbda906b-0d50-480e-8fbb-f124b8133776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Volume volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 (d8ae3e8c-ed98-424d-8ce6-a6be50102fe9): created successfully Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbda906b-0d50-480e-8fbb-f124b8133776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Flow 'volume_create_manager' (a87f2e54-717a-469d-a08e-a6c436831eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-322e0e01-a20d-410e-a80c-d2a723ad1392 tempest-ProjectReaderTests-1415224800 None] Created volume successfully. Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "cinder-quobyte-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e2adab-0f9c-47e7-a250-be397cf5c0bf]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:05 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 Jul 08 19:51:05 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:06 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9" returned: 0 in 0.861s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:06 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9 Jul 08 19:51:06 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:07 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9" returned: 0 in 0.635s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-quobyte-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9" released by "delete_volume" :: held 1.549s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Created reservations ['cfc49669-250c-4d04-9008-0a19a29fff95', '0c47c9a1-52d3-48bd-a73b-e247cbd3198f', '6413da25-b7f6-4fd0-a12d-c7717d169ca5', 'bf50342d-9873-4a10-83bb-a31a50df2383'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:07 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:51:07 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:08 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.643s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:08 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:51:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Deleted volume successfully. Jul 08 19:51:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-804e9bb6-90e2-4e96-b5b8-47a93a7b3d16 tempest-ProjectReaderTests-1415224800 None] Lock "cinder-d8ae3e8c-ed98-424d-8ce6-a6be50102fe9-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:17 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=83,cinder:UPDATE=128,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:51:18 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=85,cinder:DELETE=14,cinder:UPDATE=93,cinder:INSERT=31 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Flow 'volume_create_manager' (cafab6b2-eb1b-44fe-92bd-de9f3a91c993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c14470-2f41-4b0f-8f74-69f82fb044b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c14470-2f41-4b0f-8f74-69f82fb044b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1777030759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852eb936-c3ed-4a8b-8413-8a99603f145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c413b3c4f894bd78c06e2a15ce29568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:51:22Z,use_quota=True,user_id='444cf35cfe1342bf8805a6ca6f691d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918763dd-ce9a-47de-9cff-db01cd713947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918763dd-ce9a-47de-9cff-db01cd713947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f6e74b-ccf5-4f7c-b3c4-12dd2b9fb0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f6e74b-ccf5-4f7c-b3c4-12dd2b9fb0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852eb936-c3ed-4a8b-8413-8a99603f145c', 'volume_name': 'volume-852eb936-c3ed-4a8b-8413-8a99603f145c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7322c0-ae73-4148-b111-79f4659f55c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7322c0-ae73-4148-b111-79f4659f55c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f579f69c-215f-480f-af5f-fb15f70fe7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Volume 852eb936-c3ed-4a8b-8413-8a99603f145c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852eb936-c3ed-4a8b-8413-8a99603f145c', 'volume_size': 1} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1777030759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852eb936-c3ed-4a8b-8413-8a99603f145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c413b3c4f894bd78c06e2a15ce29568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:51:22Z,use_quota=True,user_id='444cf35cfe1342bf8805a6ca6f691d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Creating volume 852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:51:21 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:51:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:21 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c 1073741824 Jul 08 19:51:21 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:22 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c 1073741824" returned: 0 in 0.784s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:22 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:22 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:23 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.603s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f579f69c-215f-480f-af5f-fb15f70fe7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852eb936-c3ed-4a8b-8413-8a99603f145c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a0cf5f-2fe1-4b84-934f-45029952fbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:23 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Volume volume-852eb936-c3ed-4a8b-8413-8a99603f145c (852eb936-c3ed-4a8b-8413-8a99603f145c): created successfully Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a0cf5f-2fe1-4b84-934f-45029952fbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Flow 'volume_create_manager' (cafab6b2-eb1b-44fe-92bd-de9f3a91c993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-43287afd-9314-4017-bd29-47da65b795f2 tempest-SnapshotDependencyTests-1194672667 None] Created volume successfully. Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Creating offline snapshot 365c325e-b5c4-4163-a4e9-2b03da87d789 of volume 852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f608b02-2f74-4fb6-9125-0a61e5027002]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:24 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:24 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:24 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.707s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:24 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 1G Jul 08 19:51:24 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:25 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 1G" returned: 0 in 0.734s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852eb936-c3ed-4a8b-8413-8a99603f145c -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:25 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852eb936-c3ed-4a8b-8413-8a99603f145c -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 Jul 08 19:51:25 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:26 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852eb936-c3ed-4a8b-8413-8a99603f145c -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789" returned: 0 in 0.646s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:26 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 is being set with open permissions: ugo+rw Jul 08 19:51:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:26 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 Jul 08 19:51:26 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:26 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:26 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info Jul 08 19:51:26 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:27 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info" returned: 0 in 0.619s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:27 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info is being set with open permissions: ugo+rw Jul 08 19:51:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:27 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info Jul 08 19:51:27 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:28 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.info" returned: 0 in 0.647s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.080s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:28 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f9816ca8-9415-4492-bb3e-d979bb4dd8f6 tempest-SnapshotDependencyTests-1194672667 None] Create snapshot completed successfully Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Flow 'volume_create_manager' (09abb62d-49d1-47b1-9ba8-7e0c48456715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064e1580-11f9-483f-9ce0-7d6448a3e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064e1580-11f9-483f-9ce0-7d6448a3e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45da0f6a-c794-4a1c-b98c-a6923bb5c479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c413b3c4f894bd78c06e2a15ce29568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=365c325e-b5c4-4163-a4e9-2b03da87d789,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:51:30Z,use_quota=True,user_id='444cf35cfe1342bf8805a6ca6f691d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d152ad9e-6cb1-46f8-9839-1ca27c91972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d152ad9e-6cb1-46f8-9839-1ca27c91972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12708ccc-9fa7-4794-beaf-c9635e5dcd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12708ccc-9fa7-4794-beaf-c9635e5dcd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45da0f6a-c794-4a1c-b98c-a6923bb5c479', 'volume_name': 'volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479', 'volume_size': 1, 'snapshot_id': '365c325e-b5c4-4163-a4e9-2b03da87d789'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7390350c-2012-408b-bdca-70bd3a60152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7390350c-2012-408b-bdca-70bd3a60152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf0988a-3a36-4e12-aaa9-394ffc3b8dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:29 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Volume 45da0f6a-c794-4a1c-b98c-a6923bb5c479: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479', 'volume_size': 1, 'snapshot_id': '365c325e-b5c4-4163-a4e9-2b03da87d789'} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-quobyte-365c325e-b5c4-4163-a4e9-2b03da87d789-45da0f6a-c794-4a1c-b98c-a6923bb5c479" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-365c325e-b5c4-4163-a4e9-2b03da87d789-45da0f6a-c794-4a1c-b98c-a6923bb5c479" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Creating volume 45da0f6a-c794-4a1c-b98c-a6923bb5c479 from snapshot 365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-quobyte-45da0f6a-c794-4a1c-b98c-a6923bb5c479" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-45da0f6a-c794-4a1c-b98c-a6923bb5c479" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] snapshot: 365c325e-b5c4-4163-a4e9-2b03da87d789, volume: 45da0f6a-c794-4a1c-b98c-a6923bb5c479, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[446ad563-ff87-4f44-9b7e-ec21cee99fde]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:30 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 Jul 08 19:51:30 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:30 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852eb936-c3ed-4a8b-8413-8a99603f145c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e012a-eaa9-483d-bab7-23e106946185]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:30 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:30 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:31 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.725s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:31 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:51:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:31 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 Jul 08 19:51:31 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:34 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:51:34 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:35 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.981s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:51:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:51:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:51:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:51:35 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479" returned: 0 in 4.420s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[838517fc-65d7-4637-be8d-0777ec765a50]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:36 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:36 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:36 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.926s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:36 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:51:36 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Converted 1024.00 MB image at 231.61 MB/s Jul 08 19:51:36 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 is being set with open permissions: ugo+rw Jul 08 19:51:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:36 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 Jul 08 19:51:36 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:37 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479" returned: 0 in 0.613s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-45da0f6a-c794-4a1c-b98c-a6923bb5c479" released by "_copy_volume_from_snapshot" :: held 7.560s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-365c325e-b5c4-4163-a4e9-2b03da87d789-45da0f6a-c794-4a1c-b98c-a6923bb5c479" released by "_create_volume_from_snapshot" :: held 7.591s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.607s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf0988a-3a36-4e12-aaa9-394ffc3b8dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479', 'volume_size': 1, 'snapshot_id': '365c325e-b5c4-4163-a4e9-2b03da87d789'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489635c7-f78e-4f2a-8bf5-1703bdbf5f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:51:37 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Volume volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 (45da0f6a-c794-4a1c-b98c-a6923bb5c479): created successfully Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489635c7-f78e-4f2a-8bf5-1703bdbf5f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:51:37 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Flow 'volume_create_manager' (09abb62d-49d1-47b1-9ba8-7e0c48456715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:51:37 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-195e9fdc-0d33-4ab0-98be-caa09083c5b5 tempest-SnapshotDependencyTests-1194672667 None] Created volume successfully. Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-365c325e-b5c4-4163-a4e9-2b03da87d789-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-365c325e-b5c4-4163-a4e9-2b03da87d789-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-quobyte-852eb936-c3ed-4a8b-8413-8a99603f145c" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-852eb936-c3ed-4a8b-8413-8a99603f145c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-quobyte-365c325e-b5c4-4163-a4e9-2b03da87d789" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-365c325e-b5c4-4163-a4e9-2b03da87d789" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Deleting offline snapshot 365c325e-b5c4-4163-a4e9-2b03da87d789 of volume 852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] snapshot_file for this snap is: volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e740819e-769a-47f8-b8f5-06c0ad8d2280]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:38 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 Jul 08 19:51:38 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:39 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789" returned: 0 in 0.708s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852eb936-c3ed-4a8b-8413-8a99603f145c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:51:39 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dbeb4a-bbd5-4270-b734-c090dca3792a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:39 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:40 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.703s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:40 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 Jul 08 19:51:40 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:40 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789" returned: 0 in 0.687s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:40 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789 Jul 08 19:51:40 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:41 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c.365c325e-b5c4-4163-a4e9-2b03da87d789" returned: 0 in 0.612s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-365c325e-b5c4-4163-a4e9-2b03da87d789" released by "_delete_snapshot" :: held 2.798s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-852eb936-c3ed-4a8b-8413-8a99603f145c" released by "delete_snapshot" :: held 2.854s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Created reservations ['3eb6c1d9-f8ba-4599-88f3-1ecba4b9ad45', '440583e7-4694-4187-8a33-7781e6b0830b', '29ecf4bb-52d1-4ee1-bf41-38710c06e4dd', '0632f9b7-51d9-460b-a8f7-bdf0dddc12b4'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:51:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Delete snapshot completed successfully. Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223ed76-c9aa-4548-be9b-dd7383b2d9f6 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-365c325e-b5c4-4163-a4e9-2b03da87d789-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-852eb936-c3ed-4a8b-8413-8a99603f145c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-852eb936-c3ed-4a8b-8413-8a99603f145c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-quobyte-852eb936-c3ed-4a8b-8413-8a99603f145c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-852eb936-c3ed-4a8b-8413-8a99603f145c" acquired by "delete_volume" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[888fd216-7a37-46c5-a1c4-45c424698c9d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:41 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:41 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:42 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.718s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:42 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c Jul 08 19:51:42 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:43 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-852eb936-c3ed-4a8b-8413-8a99603f145c" returned: 0 in 0.615s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-852eb936-c3ed-4a8b-8413-8a99603f145c" released by "delete_volume" :: held 1.383s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Created reservations ['6a4c5baa-9d84-471a-b154-689415d396b6', '9585886f-2690-4b39-98f4-c54c358a1462', '4e491146-ffd4-4999-8e4a-9d8b1bf0b5a0', 'cac21b8e-acf9-48d9-ac3d-d76295395062'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:43 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:51:43 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:43 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.607s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:51:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Deleted volume successfully. Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dfba3a91-9c7d-416a-b4b1-7321eecc046e tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-852eb936-c3ed-4a8b-8413-8a99603f145c-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-45da0f6a-c794-4a1c-b98c-a6923bb5c479-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-45da0f6a-c794-4a1c-b98c-a6923bb5c479-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "cinder-quobyte-45da0f6a-c794-4a1c-b98c-a6923bb5c479" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-45da0f6a-c794-4a1c-b98c-a6923bb5c479" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece82ca-d490-43b9-a659-960d89f3a10d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:51:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:44 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 Jul 08 19:51:44 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:44 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479" returned: 0 in 0.724s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:44 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479 Jul 08 19:51:44 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:45 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-45da0f6a-c794-4a1c-b98c-a6923bb5c479" returned: 0 in 0.608s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-quobyte-45da0f6a-c794-4a1c-b98c-a6923bb5c479" released by "delete_volume" :: held 1.366s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Created reservations ['593e3e9b-70a8-43fe-8d3f-27e864ccfb7a', '93cca34d-0de0-49be-a123-9223d16b74ab', '053bcf4e-341d-4357-af91-3af680389631', '6a5e309b-c472-4783-8bfa-a94f148452b9'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:51:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:51:45 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:51:45 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:51:46 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 19:51:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.622s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:51:46 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:51:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Deleted volume successfully. Jul 08 19:51:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-94d41a2e-2348-4e3e-b3b8-cf177a7b5715 tempest-SnapshotDependencyTests-1194672667 None] Lock "cinder-45da0f6a-c794-4a1c-b98c-a6923bb5c479-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:51:55 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:51:56 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=27,cinder:SELECT=26,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:52:04 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:04 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (c47568eb-bb1f-4fec-996b-4a7e591ec8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0f3363-9afd-4c9e-b2f3-cf6d44b32bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (88c29a69-2792-4cae-8ee2-8ef0e4e305dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e569f5a2-4c6a-4c4e-9d9d-bd6c1d881653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0f3363-9afd-4c9e-b2f3-cf6d44b32bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-720242246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299bed51-f8a4-442f-91ed-9507bfe3fa93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:05Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5684a2b2-e79a-4cbe-9122-51b2219cc44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5684a2b2-e79a-4cbe-9122-51b2219cc44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bfc42f-a3e9-4689-814b-d04bc8f96147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bfc42f-a3e9-4689-814b-d04bc8f96147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299bed51-f8a4-442f-91ed-9507bfe3fa93', 'volume_name': 'volume-299bed51-f8a4-442f-91ed-9507bfe3fa93', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ac52a6-9393-4c85-a40b-0988912fd1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ac52a6-9393-4c85-a40b-0988912fd1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472a5100-038e-4cde-976c-23c85b411460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume 299bed51-f8a4-442f-91ed-9507bfe3fa93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299bed51-f8a4-442f-91ed-9507bfe3fa93', 'volume_size': 1} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-720242246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299bed51-f8a4-442f-91ed-9507bfe3fa93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:05Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Creating volume 299bed51-f8a4-442f-91ed-9507bfe3fa93 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:05 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e569f5a2-4c6a-4c4e-9d9d-bd6c1d881653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-516126978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94cd06ac-4aed-4abc-a2e0-e3b4d6501400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:05Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 1073741824 Jul 08 19:52:05 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d58474-d9bf-42b1-af38-0c6d15149761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d58474-d9bf-42b1-af38-0c6d15149761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25d7bb3-d3f4-4fe4-8bb5-b75c0daa0976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25d7bb3-d3f4-4fe4-8bb5-b75c0daa0976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94cd06ac-4aed-4abc-a2e0-e3b4d6501400', 'volume_name': 'volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026dce4e-ad58-4c1b-b842-f18254edb291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026dce4e-ad58-4c1b-b842-f18254edb291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df300cd5-2814-4b8c-82d1-670ab5a89dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Volume 94cd06ac-4aed-4abc-a2e0-e3b4d6501400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400', 'volume_size': 1} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (75532417-06f0-461f-92a3-fecb0186bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7100da41-5b84-4f90-8ecf-d296a6323498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7100da41-5b84-4f90-8ecf-d296a6323498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051969443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab7f607-4494-4bd7-8edc-56e131c76e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:05Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee25b07-1ae9-424b-b556-2984de160cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee25b07-1ae9-424b-b556-2984de160cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6383c9-1b51-4b56-83a7-a508aa2a63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6383c9-1b51-4b56-83a7-a508aa2a63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab7f607-4494-4bd7-8edc-56e131c76e49', 'volume_name': 'volume-7ab7f607-4494-4bd7-8edc-56e131c76e49', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610a397-992e-4bf3-8ca0-c31fdd281819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b610a397-992e-4bf3-8ca0-c31fdd281819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9605e14-bedd-4d5d-8a7d-bc2488d01d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Volume 7ab7f607-4494-4bd7-8edc-56e131c76e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab7f607-4494-4bd7-8edc-56e131c76e49', 'volume_size': 1} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (4b4490d8-4d1b-45e1-98f3-8e826d339232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245c1e97-f34c-464b-b808-7ec89141b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245c1e97-f34c-464b-b808-7ec89141b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148556731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2a3f52-a25d-4dad-bb05-1fc0a38fff79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:06Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d3460a-146d-48c6-8426-ef5a1a1fcc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d3460a-146d-48c6-8426-ef5a1a1fcc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0719a4ac-eacc-4415-82b7-c502cfdfc389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0719a4ac-eacc-4415-82b7-c502cfdfc389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2a3f52-a25d-4dad-bb05-1fc0a38fff79', 'volume_name': 'volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33efaedc-afbe-4e9f-bb88-876d25ba06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33efaedc-afbe-4e9f-bb88-876d25ba06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df5c905-f28a-4a0a-9283-0e43919ff450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume 0c2a3f52-a25d-4dad-bb05-1fc0a38fff79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79', 'volume_size': 1} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (d8b12c65-24a9-4661-a73a-969342ee34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63c9a3f-7ab4-4d50-8408-46e4dd4de5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63c9a3f-7ab4-4d50-8408-46e4dd4de5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485800363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb797b78-b40b-4854-8a54-cffc8e699f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:06Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0fdff7-30cd-44af-9d7a-e7cc4e0deb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0fdff7-30cd-44af-9d7a-e7cc4e0deb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cb9e9a-3a33-4612-bad1-b52a6804cbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cb9e9a-3a33-4612-bad1-b52a6804cbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb797b78-b40b-4854-8a54-cffc8e699f30', 'volume_name': 'volume-cb797b78-b40b-4854-8a54-cffc8e699f30', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b8d96-4518-441b-a6be-c5f7fbaf50e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b8d96-4518-441b-a6be-c5f7fbaf50e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d7033f-e9c3-4ae4-b793-0b5973c67bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Volume cb797b78-b40b-4854-8a54-cffc8e699f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb797b78-b40b-4854-8a54-cffc8e699f30', 'volume_size': 1} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (2c40c72c-f6d5-41e6-9569-ad68e14d829e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0777fe31-97d4-4595-92c5-6d0b329d4da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0777fe31-97d4-4595-92c5-6d0b329d4da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724285548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9465f69-932d-4e91-a8d9-38cef6e21046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:06Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee584b0-b8e2-4c9a-bea7-91f51948335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee584b0-b8e2-4c9a-bea7-91f51948335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f09f96-6ed4-4a82-a7ba-0867b6f59d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f09f96-6ed4-4a82-a7ba-0867b6f59d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9465f69-932d-4e91-a8d9-38cef6e21046', 'volume_name': 'volume-f9465f69-932d-4e91-a8d9-38cef6e21046', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c5a667-a63c-4c87-ac8b-703b84c85bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c5a667-a63c-4c87-ac8b-703b84c85bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83237e17-dff1-4416-b3a3-91548d0e3c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Volume f9465f69-932d-4e91-a8d9-38cef6e21046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9465f69-932d-4e91-a8d9-38cef6e21046', 'volume_size': 1} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 1073741824" returned: 0 in 1.239s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:06 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 Jul 08 19:52:06 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (b53f836c-b85f-4811-98a7-ef557f786bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09acd160-ddfc-43e0-b0eb-70f19240edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09acd160-ddfc-43e0-b0eb-70f19240edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240804203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e9b9f5-cfd7-4184-b40b-7b7758dcc79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:07Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d9a631-5b5d-4114-a169-c52cf6721708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d9a631-5b5d-4114-a169-c52cf6721708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d6cc9f-96f9-4434-a428-45d162c8d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d6cc9f-96f9-4434-a428-45d162c8d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e9b9f5-cfd7-4184-b40b-7b7758dcc79f', 'volume_name': 'volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5a186a-7d20-4d17-a65c-971b2c39c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5a186a-7d20-4d17-a65c-971b2c39c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89653e66-df78-49da-88c7-d75fb7da634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:06 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Volume 24e9b9f5-cfd7-4184-b40b-7b7758dcc79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f', 'volume_size': 1} Jul 08 19:52:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:07 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93" returned: 0 in 0.665s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-516126978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94cd06ac-4aed-4abc-a2e0-e3b4d6501400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:05Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Creating volume 94cd06ac-4aed-4abc-a2e0-e3b4d6501400 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:07 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:07 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 1073741824 Jul 08 19:52:07 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472a5100-038e-4cde-976c-23c85b411460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299bed51-f8a4-442f-91ed-9507bfe3fa93', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1930d8-a91f-446d-ba92-9f7d60a84f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:07 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 (299bed51-f8a4-442f-91ed-9507bfe3fa93): created successfully Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1930d8-a91f-446d-ba92-9f7d60a84f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (c47568eb-bb1f-4fec-996b-4a7e591ec8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-deccd866-e26e-4102-9128-46e4cdddd900 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created volume successfully. Jul 08 19:52:07 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 1073741824" returned: 0 in 0.864s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:08 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 Jul 08 19:52:08 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (7d5e9649-7fa2-494b-b71a-0540eb86a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf760664-bde2-49e3-a0bb-95c95dfa7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf760664-bde2-49e3-a0bb-95c95dfa7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1769741571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05812fc5-6d55-4827-be86-eaf4e698640a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:08Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73cbc58-505c-4f4c-906b-c4d49a0eb8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73cbc58-505c-4f4c-906b-c4d49a0eb8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed1255c-aa62-481d-9514-a4f9eebe56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed1255c-aa62-481d-9514-a4f9eebe56e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05812fc5-6d55-4827-be86-eaf4e698640a', 'volume_name': 'volume-05812fc5-6d55-4827-be86-eaf4e698640a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5461c703-cd40-44e6-8465-03c82cd931a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5461c703-cd40-44e6-8465-03c82cd931a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651eb9bb-362a-4c1c-8aa3-b2a3113a50f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:08 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume 05812fc5-6d55-4827-be86-eaf4e698640a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05812fc5-6d55-4827-be86-eaf4e698640a', 'volume_size': 1} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:08 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400" returned: 0 in 0.867s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051969443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab7f607-4494-4bd7-8edc-56e131c76e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:05Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Creating volume 7ab7f607-4494-4bd7-8edc-56e131c76e49 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:08 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df300cd5-2814-4b8c-82d1-670ab5a89dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:08 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46baa567-9abc-4c32-bf53-3d165b03b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:08 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 1073741824 Jul 08 19:52:08 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:08 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Volume volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 (94cd06ac-4aed-4abc-a2e0-e3b4d6501400): created successfully Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46baa567-9abc-4c32-bf53-3d165b03b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (88c29a69-2792-4cae-8ee2-8ef0e4e305dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:09 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f47ead82-4e35-4f55-ab21-6d57455b11a1 tempest-CreateVolumesFromImageTest-654355793 None] Created volume successfully. Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (754417cb-bd39-47f6-8634-c7f55df9f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141cd8db-791e-4f80-98ad-c556f9797df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (141cd8db-791e-4f80-98ad-c556f9797df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749407900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01160aa-b663-4997-9976-27e63e632be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:09Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6979f0b0-c4ff-4f3a-b71d-854c691d04c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6979f0b0-c4ff-4f3a-b71d-854c691d04c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db075390-deca-477b-8faa-89e5d1cff951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db075390-deca-477b-8faa-89e5d1cff951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd01160aa-b663-4997-9976-27e63e632be9', 'volume_name': 'volume-d01160aa-b663-4997-9976-27e63e632be9', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b812b98a-3f64-475e-969f-be1924865886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b812b98a-3f64-475e-969f-be1924865886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559651f5-1372-49cb-9309-a9af11b131d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume d01160aa-b663-4997-9976-27e63e632be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d01160aa-b663-4997-9976-27e63e632be9', 'volume_size': 1} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (b318d697-f910-4176-976e-4bfdecce2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9236cc-c1ff-47bd-99ea-5c0de2179943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9236cc-c1ff-47bd-99ea-5c0de2179943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1377217288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8517c1f9-d940-403d-91c6-4b2d22e82728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f9196d-f359-4173-8da9-8637e726029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f9196d-f359-4173-8da9-8637e726029f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870e93eb-4e61-4558-bb92-717c38f4f443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870e93eb-4e61-4558-bb92-717c38f4f443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8517c1f9-d940-403d-91c6-4b2d22e82728', 'volume_name': 'volume-8517c1f9-d940-403d-91c6-4b2d22e82728', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028e6b67-8cc2-4f2b-91a7-97b9556311d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028e6b67-8cc2-4f2b-91a7-97b9556311d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45e6879-1ea3-412b-8a6e-c4e615507436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:09 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume 8517c1f9-d940-403d-91c6-4b2d22e82728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8517c1f9-d940-403d-91c6-4b2d22e82728', 'volume_size': 1} Jul 08 19:52:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 1073741824" returned: 0 in 1.089s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Flow 'volume_create_manager' (26619a3b-1ca1-43c0-833f-fd03457c84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f796e6f1-5b41-4722-aae9-d4cf1b2bddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f796e6f1-5b41-4722-aae9-d4cf1b2bddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc359d7-2dc7-48bc-8d38-3fa567749da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d04bd255db4b8497716423ae941cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='7a2010bca1944385b539f45146b37cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03d562b2-f022-4037-a7db-9ab3d52f4366),volume_type_id=03d562b2-f022-4037-a7db-9ab3d52f4366)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c66ce8-736a-4e20-91c9-7ffa9d0a9770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c66ce8-736a-4e20-91c9-7ffa9d0a9770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e4c694-1562-41db-839f-6d246dfa7a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:10 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 Jul 08 19:52:10 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (c1f9caec-8260-414a-af3f-440d186ff6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228de789-7e80-4b30-8b70-59c85ebc5ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228de789-7e80-4b30-8b70-59c85ebc5ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538347476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc3c08d-f361-4706-a3f5-3d357eef1f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74b81c2-1c87-4610-a22d-1c2bb1c6b9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74b81c2-1c87-4610-a22d-1c2bb1c6b9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e22bc9f-36ba-4cc2-8578-d8c0018b30b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e22bc9f-36ba-4cc2-8578-d8c0018b30b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc3c08d-f361-4706-a3f5-3d357eef1f37', 'volume_name': 'volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8687c6af-bf05-40a4-ad3b-8d880054175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8687c6af-bf05-40a4-ad3b-8d880054175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdab95c-3bcd-4fd1-ae0c-7d823310aa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume 7cc3c08d-f361-4706-a3f5-3d357eef1f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37', 'volume_size': 1} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (330bbb5d-a3ec-4668-b968-5bc2eb09b2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2199ce7e-d756-4b05-af48-cd6eb786e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2199ce7e-d756-4b05-af48-cd6eb786e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913029901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadccce3-02d1-42c6-8a6b-dbf9f57cc46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4562831a-11e4-4431-ac8c-a49915c0fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4562831a-11e4-4431-ac8c-a49915c0fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74feb076-c233-41a6-b836-c50eac66eeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74feb076-c233-41a6-b836-c50eac66eeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadccce3-02d1-42c6-8a6b-dbf9f57cc46f', 'volume_name': 'volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa23d9ab-f68e-42ef-95dd-ab55a42b6b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa23d9ab-f68e-42ef-95dd-ab55a42b6b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb46992-0998-4743-9085-dee836243dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume fadccce3-02d1-42c6-8a6b-dbf9f57cc46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f', 'volume_size': 1} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e4c694-1562-41db-839f-6d246dfa7a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bc359d7-2dc7-48bc-8d38-3fa567749da9', 'volume_name': 'volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9', 'volume_size': 1, 'image_id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab02c35e2ba1c1afcdd22d809cfe5a18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4d04bd255db4b8497716423ae941cc1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ebb6a0cb722912a8b6a9367ffe5080bfed9912697d54843a36240c08448d1da00d5708282cec0e643c4980e78f303e59816a47e8bae7c98eb18ddf63c8b9657', 'id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'created_at': datetime.datetime(2026, 7, 8, 17, 52, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 52, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9ff81-722c-4a0b-b333-6132ec5e2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9ff81-722c-4a0b-b333-6132ec5e2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24333b44-d382-4c08-acda-5f5950970a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Volume 0bc359d7-2dc7-48bc-8d38-3fa567749da9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9', 'volume_size': 1, 'image_id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab02c35e2ba1c1afcdd22d809cfe5a18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4d04bd255db4b8497716423ae941cc1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ebb6a0cb722912a8b6a9367ffe5080bfed9912697d54843a36240c08448d1da00d5708282cec0e643c4980e78f303e59816a47e8bae7c98eb18ddf63c8b9657', 'id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'created_at': datetime.datetime(2026, 7, 8, 17, 52, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 52, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Trying to clone 0bc359d7-2dc7-48bc-8d38-3fa567749da9 from image 6f5008d3-46da-40e6-bdf3-2bc7c50481cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Image download 0.00 MB at 0.00 MB/s Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a7d6f5-40e7-4ec1-896a-a20012a1660e]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:10 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD Jul 08 19:52:10 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:10 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49" returned: 0 in 0.670s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.030s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148556731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2a3f52-a25d-4dad-bb05-1fc0a38fff79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:06Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating volume 0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9605e14-bedd-4d5d-8a7d-bc2488d01d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab7f607-4494-4bd7-8edc-56e131c76e49', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 1073741824 Jul 08 19:52:10 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde8cad9-d823-49bb-9d91-4d6b2b3bab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Volume volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 (7ab7f607-4494-4bd7-8edc-56e131c76e49): created successfully Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde8cad9-d823-49bb-9d91-4d6b2b3bab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (75532417-06f0-461f-92a3-fecb0186bb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-87adcfdf-1f70-404b-80cf-694177fa945d tempest-CreateVolumesFromImageTest-654355793 None] Created volume successfully. Jul 08 19:52:11 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:11 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD Jul 08 19:52:11 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:11 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 1073741824" returned: 0 in 0.865s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:11 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 Jul 08 19:52:11 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:12 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD" returned: 1 in 0.735s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Temporary image 6f5008d3-46da-40e6-bdf3-2bc7c50481cf is fetched for user 7a2010bca1944385b539f45146b37cd5. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be44e3-0741-4e1f-8cf4-b372b9370d03]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:12 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD Jul 08 19:52:12 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:12 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" returned: 0 in 0.676s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1485800363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb797b78-b40b-4854-8a54-cffc8e699f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:06Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Creating volume cb797b78-b40b-4854-8a54-cffc8e699f30 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:12 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df5c905-f28a-4a0a-9283-0e43919ff450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:12 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 1073741824 Jul 08 19:52:12 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32eeffc5-5201-4b46-aaed-e94ad0196695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:12 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 (0c2a3f52-a25d-4dad-bb05-1fc0a38fff79): created successfully Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32eeffc5-5201-4b46-aaed-e94ad0196695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:12 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (4b4490d8-4d1b-45e1-98f3-8e826d339232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4552f805-1573-43f6-93a1-14b8dfa67830 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created volume successfully. Jul 08 19:52:12 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:13 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD Jul 08 19:52:13 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:13 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 1073741824" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:13 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 Jul 08 19:52:13 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:13 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD" returned: 1 in 0.780s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:52:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:14 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30" returned: 0 in 0.679s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.653s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-724285548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9465f69-932d-4e91-a8d9-38cef6e21046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:06Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Creating volume f9465f69-932d-4e91-a8d9-38cef6e21046 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:14 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:14 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 1073741824 Jul 08 19:52:14 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d7033f-e9c3-4ae4-b793-0b5973c67bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb797b78-b40b-4854-8a54-cffc8e699f30', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213043e2-b8d2-4ae5-be6d-af759dbf69af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:14 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Volume volume-cb797b78-b40b-4854-8a54-cffc8e699f30 (cb797b78-b40b-4854-8a54-cffc8e699f30): created successfully Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213043e2-b8d2-4ae5-be6d-af759dbf69af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (d8b12c65-24a9-4661-a73a-969342ee34fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:14 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e1d644e9-2132-4ecf-a7cf-b96f2a9e39d0 tempest-CreateVolumesFromImageTest-654355793 None] Created volume successfully. Jul 08 19:52:14 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 1073741824" returned: 0 in 0.792s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:14 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 Jul 08 19:52:14 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:15 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046" returned: 0 in 0.608s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.655s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240804203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e9b9f5-cfd7-4184-b40b-7b7758dcc79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ef54600194b098137021332f79318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:07Z,use_quota=True,user_id='df030baf207f455497705a42d7b281c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Creating volume 24e9b9f5-cfd7-4184-b40b-7b7758dcc79f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:15 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:15 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f 1073741824 Jul 08 19:52:15 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83237e17-dff1-4416-b3a3-91548d0e3c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9465f69-932d-4e91-a8d9-38cef6e21046', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812fe888-7c2c-43fe-aa9b-56f5b5bf4b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Volume volume-f9465f69-932d-4e91-a8d9-38cef6e21046 (f9465f69-932d-4e91-a8d9-38cef6e21046): created successfully Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812fe888-7c2c-43fe-aa9b-56f5b5bf4b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (2c40c72c-f6d5-41e6-9569-ad68e14d829e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e9b975b9-830c-4e31-8acd-f8eb84749b5f tempest-CreateVolumesFromImageTest-654355793 None] Created volume successfully. Jul 08 19:52:16 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f 1073741824" returned: 0 in 0.784s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:16 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f Jul 08 19:52:16 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:16 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f" returned: 0 in 0.666s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.468s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1769741571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05812fc5-6d55-4827-be86-eaf4e698640a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:08Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Creating volume 05812fc5-6d55-4827-be86-eaf4e698640a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:16 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89653e66-df78-49da-88c7-d75fb7da634b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:17 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a 1073741824 Jul 08 19:52:17 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6de3cae-6c58-419c-9667-d6c54f2bbc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Volume volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f (24e9b9f5-cfd7-4184-b40b-7b7758dcc79f): created successfully Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6de3cae-6c58-419c-9667-d6c54f2bbc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Flow 'volume_create_manager' (b53f836c-b85f-4811-98a7-ef557f786bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5b15f671-e9c2-45dd-a57c-9d06bbf56b7e tempest-CreateVolumesFromImageTest-654355793 None] Created volume successfully. Jul 08 19:52:17 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a 1073741824" returned: 0 in 0.847s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:17 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a Jul 08 19:52:17 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-quobyte-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f" acquired by "delete_volume" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c1621-1d84-4b44-add5-e96889a643c5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:18 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f Jul 08 19:52:18 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:18 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a" returned: 0 in 0.678s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.232s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-749407900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d01160aa-b663-4997-9976-27e63e632be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:09Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Creating volume d01160aa-b663-4997-9976-27e63e632be9 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:18 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:18 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 1073741824 Jul 08 19:52:18 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651eb9bb-362a-4c1c-8aa3-b2a3113a50f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05812fc5-6d55-4827-be86-eaf4e698640a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852e1269-9544-406b-ac79-1b10069353e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:18 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume volume-05812fc5-6d55-4827-be86-eaf4e698640a (05812fc5-6d55-4827-be86-eaf4e698640a): created successfully Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852e1269-9544-406b-ac79-1b10069353e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (7d5e9649-7fa2-494b-b71a-0540eb86a58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9b2d50e0-af67-45de-83bc-c8d5462b1abe tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created volume successfully. Jul 08 19:52:18 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f" returned: 0 in 0.795s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:18 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f Jul 08 19:52:18 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:19 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 1073741824" returned: 0 in 0.831s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:19 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f" returned: 0 in 0.647s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:19 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 Jul 08 19:52:19 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f" released by "delete_volume" :: held 1.505s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Created reservations ['c313fcc1-7402-4aa8-83ce-782fee3628d2', '8d5944bf-186a-48f3-bf6b-8c99d2288e66', 'cba2bb56-77a4-4eec-9722-fa7e447fb579', '7f0c50f9-a672-4b85-9b71-46ebd6f29e5c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:19 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:19 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:20 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9" returned: 0 in 0.612s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.066s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1377217288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8517c1f9-d940-403d-91c6-4b2d22e82728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Creating volume 8517c1f9-d940-403d-91c6-4b2d22e82728 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:20 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:20 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 1073741824 Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559651f5-1372-49cb-9309-a9af11b131d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d01160aa-b663-4997-9976-27e63e632be9', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:20 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b32d8c-dbee-4569-aaad-cf3a0f8a1a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-f9465f69-932d-4e91-a8d9-38cef6e21046-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume volume-d01160aa-b663-4997-9976-27e63e632be9 (d01160aa-b663-4997-9976-27e63e632be9): created successfully Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b32d8c-dbee-4569-aaad-cf3a0f8a1a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (754417cb-bd39-47f6-8634-c7f55df9f4af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-f9465f69-932d-4e91-a8d9-38cef6e21046-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d5e610b4-4239-4e2b-998a-9ae235589e9f tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created volume successfully. Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-quobyte-f9465f69-932d-4e91-a8d9-38cef6e21046" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-f9465f69-932d-4e91-a8d9-38cef6e21046" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ed1827-389a-4352-b3a4-a619e196bd50]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:20 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.709s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Deleted volume successfully. Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0d0884e9-197b-4c3a-ac64-6e4ec977351f tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-24e9b9f5-cfd7-4184-b40b-7b7758dcc79f-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:20 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 Jul 08 19:52:20 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:20 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 1073741824" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:21 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 Jul 08 19:52:21 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:21 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046" returned: 0 in 0.786s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:21 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046 Jul 08 19:52:21 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:21 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728" returned: 0 in 0.654s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.349s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538347476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc3c08d-f361-4706-a3f5-3d357eef1f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Creating volume 7cc3c08d-f361-4706-a3f5-3d357eef1f37 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:21 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:21 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:21 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 1073741824 Jul 08 19:52:21 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45e6879-1ea3-412b-8a6e-c4e615507436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8517c1f9-d940-403d-91c6-4b2d22e82728', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b541a672-621f-4c66-9d94-2ef665fc4b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f9465f69-932d-4e91-a8d9-38cef6e21046" returned: 0 in 0.652s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume volume-8517c1f9-d940-403d-91c6-4b2d22e82728 (8517c1f9-d940-403d-91c6-4b2d22e82728): created successfully Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b541a672-621f-4c66-9d94-2ef665fc4b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (b318d697-f910-4176-976e-4bfdecce2368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-f9465f69-932d-4e91-a8d9-38cef6e21046" released by "delete_volume" :: held 1.503s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b6ffa6a2-0767-44ad-94bd-0e3a5cdc7497 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created volume successfully. Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Created reservations ['23c80a44-f7dc-4e8c-8fa8-98043281a23d', '55cb57a0-77f7-418a-a7ac-53e5bde99bdf', '63b2985a-c6bc-4973-9cfe-730d6394f997', 'e304a08c-ffd4-4e00-961a-5eb75c9e62d0'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:21 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:21 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-cb797b78-b40b-4854-8a54-cffc8e699f30-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-cb797b78-b40b-4854-8a54-cffc8e699f30-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-quobyte-cb797b78-b40b-4854-8a54-cffc8e699f30" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-cb797b78-b40b-4854-8a54-cffc8e699f30" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074ff49-938b-44f7-be93-0c61fe2d90f1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:22 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.682s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Deleted volume successfully. Jul 08 19:52:22 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 1073741824" returned: 0 in 0.891s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1dc4fd07-4f59-4689-b0a9-ce2def248da6 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-f9465f69-932d-4e91-a8d9-38cef6e21046-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:22 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 Jul 08 19:52:22 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:22 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 Jul 08 19:52:22 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:23 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.832s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913029901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadccce3-02d1-42c6-8a6b-dbf9f57cc46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc256ce6e8a40f8814deccbc85e459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='a07eea5a996e4c2d87e2e494fb147247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Creating volume fadccce3-02d1-42c6-8a6b-dbf9f57cc46f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:23 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:23 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30" returned: 0 in 0.769s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:23 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f 1073741824 Jul 08 19:52:23 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdab95c-3bcd-4fd1-ae0c-7d823310aa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:23 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30 Jul 08 19:52:23 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82217785-5697-4d35-a146-1fc81b5fda9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:23 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 (7cc3c08d-f361-4706-a3f5-3d357eef1f37): created successfully Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82217785-5697-4d35-a146-1fc81b5fda9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (c1f9caec-8260-414a-af3f-440d186ff6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f17fb554-a30c-4fe7-8823-8d1d0b1dbfb9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created volume successfully. Jul 08 19:52:23 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cb797b78-b40b-4854-8a54-cffc8e699f30" returned: 0 in 0.675s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-cb797b78-b40b-4854-8a54-cffc8e699f30" released by "delete_volume" :: held 1.481s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Created reservations ['664a94ab-43b6-436e-a84b-4cfac6de8175', '835f9c90-320e-4344-85b0-0e61051fcfa5', '38e9be1c-5164-4787-9fc4-5a9b26515323', '42d7e346-256e-48a2-8f9d-29896bc43fdf'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:24 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f 1073741824" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:24 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:24 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:24 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f Jul 08 19:52:24 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-7ab7f607-4494-4bd7-8edc-56e131c76e49-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-7ab7f607-4494-4bd7-8edc-56e131c76e49-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-quobyte-7ab7f607-4494-4bd7-8edc-56e131c76e49" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-7ab7f607-4494-4bd7-8edc-56e131c76e49" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb3a48-5835-48b9-9f62-df4ab5211533]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:24 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.668s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Deleted volume successfully. Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-52ca0b2b-d9a8-438c-809c-418c93d000a7 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-cb797b78-b40b-4854-8a54-cffc8e699f30-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:24 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f" returned: 0 in 0.684s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.648s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb46992-0998-4743-9085-dee836243dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f629fe-c904-49ae-b0cd-43ea2c5c5dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating offline snapshot 766fdf50-c5b8-47c0-a43e-4e54136fd4cb of volume 0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:52:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Volume volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f (fadccce3-02d1-42c6-8a6b-dbf9f57cc46f): created successfully Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f629fe-c904-49ae-b0cd-43ea2c5c5dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Flow 'volume_create_manager' (330bbb5d-a3ec-4668-b968-5bc2eb09b2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2da2e31-801c-415e-95cf-dd989d04c101]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:24 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 Jul 08 19:52:24 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-011b1583-f777-4d61-9ade-87ebf571df27 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created volume successfully. Jul 08 19:52:24 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 Jul 08 19:52:24 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-quobyte-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:25 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49" returned: 0 in 0.854s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec6ee55-8939-4dd2-b693-bdf1dd93bc50]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:25 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49 Jul 08 19:52:25 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:25 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" returned: 0 in 0.805s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:25 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb 1G Jul 08 19:52:25 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:25 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f Jul 08 19:52:25 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:26 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7ab7f607-4494-4bd7-8edc-56e131c76e49" returned: 0 in 0.664s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-7ab7f607-4494-4bd7-8edc-56e131c76e49" released by "delete_volume" :: held 1.559s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Created reservations ['e743a296-c8f2-4959-84ec-127a134a91ee', 'b1f1f605-83d7-4452-87f2-610ca55d755d', '6bde9089-b7b3-41f4-9c22-b6e4300300f9', '52b580ca-a6b3-4669-90e6-500d0ac484ac'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:26 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f" returned: 0 in 0.829s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:26 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:26 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:26 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f Jul 08 19:52:26 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:26 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb 1G" returned: 0 in 0.847s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:26 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb Jul 08 19:52:26 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-94cd06ac-4aed-4abc-a2e0-e3b4d6501400-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-94cd06ac-4aed-4abc-a2e0-e3b4d6501400-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "cinder-quobyte-94cd06ac-4aed-4abc-a2e0-e3b4d6501400" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-94cd06ac-4aed-4abc-a2e0-e3b4d6501400" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf00361-e4e4-475f-96e9-3f9bac2a36c1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:27 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 Jul 08 19:52:27 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:27 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f" returned: 0 in 0.747s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f" released by "delete_volume" :: held 1.632s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:27 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.819s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Deleted volume successfully. Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created reservations ['d2667dbe-9411-4956-9c32-42b85fc7fb04', 'e05a6f8a-7a5d-4c12-80dd-5363ff26a988', 'b40b00d7-5b1a-4b65-8244-d93132214518', 'cadc2979-e656-49fc-816b-78646b16cd63'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:27 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bd0ef579-2bdf-480a-8817-5d457bd38899 tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-7ab7f607-4494-4bd7-8edc-56e131c76e49-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb" returned: 0 in 0.758s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:27 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb is being set with open permissions: ugo+rw Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:27 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb Jul 08 19:52:27 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:27 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:27 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-7cc3c08d-f361-4706-a3f5-3d357eef1f37-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-7cc3c08d-f361-4706-a3f5-3d357eef1f37-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-quobyte-7cc3c08d-f361-4706-a3f5-3d357eef1f37" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:27 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400" returned: 0 in 0.907s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-7cc3c08d-f361-4706-a3f5-3d357eef1f37" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:27 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400 Jul 08 19:52:27 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0b534f-a4b2-4a56-ada7-577a0f107a9d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:28 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:28 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.710s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb" returned: 0 in 0.797s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:28 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Deleted volume successfully. Jul 08 19:52:28 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:28 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-507716db-a889-444d-bac4-757fd8516a1c tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-fadccce3-02d1-42c6-8a6b-dbf9f57cc46f-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:28 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info Jul 08 19:52:28 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:28 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-94cd06ac-4aed-4abc-a2e0-e3b4d6501400" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-quobyte-94cd06ac-4aed-4abc-a2e0-e3b4d6501400" released by "delete_volume" :: held 1.691s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Created reservations ['050cdb7f-e185-47ec-a166-ff61bcaf516e', 'eeaad640-bfbc-4710-ab1f-634ca7c130c1', 'c64b3fef-a809-4a95-bf0f-e73e62b8b097', '46f218b8-1cc7-49a8-8335-0e1b0e57beb6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:28 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37" returned: 0 in 0.862s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:28 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info" returned: 0 in 0.719s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:28 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info is being set with open permissions: ugo+rw Jul 08 19:52:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:28 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:28 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:28 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37 Jul 08 19:52:28 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:28 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info Jul 08 19:52:28 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:29 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7cc3c08d-f361-4706-a3f5-3d357eef1f37" returned: 0 in 0.675s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-7cc3c08d-f361-4706-a3f5-3d357eef1f37" released by "delete_volume" :: held 1.587s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:29 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.732s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Deleted volume successfully. Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-959e2482-e08f-4107-a18f-b08e55d61dab tempest-CreateVolumesFromImageTest-654355793 None] Lock "cinder-94cd06ac-4aed-4abc-a2e0-e3b4d6501400-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created reservations ['d09b7b3e-b032-4023-9bda-3574d21af1ab', 'eecc20c5-ef87-4359-905b-2855297afadd', '120ef9a3-d380-45c7-8b3d-b0b7d0eb9854', 'bb2f7d20-96d7-4cad-a795-fe89e0b52037'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:29 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.info" returned: 0 in 0.780s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.839s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.852s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc359d7-2dc7-48bc-8d38-3fa567749da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4d04bd255db4b8497716423ae941cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:10Z,use_quota=True,user_id='7a2010bca1944385b539f45146b37cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03d562b2-f022-4037-a7db-9ab3d52f4366),volume_type_id=03d562b2-f022-4037-a7db-9ab3d52f4366)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Creating volume 0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:29 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:29 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 1073741824 Jul 08 19:52:29 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-696ac7fb-c223-4773-bc9e-1f0209537941 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Create snapshot completed successfully Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:29 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:29 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-8517c1f9-d940-403d-91c6-4b2d22e82728-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-8517c1f9-d940-403d-91c6-4b2d22e82728-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-quobyte-8517c1f9-d940-403d-91c6-4b2d22e82728" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-8517c1f9-d940-403d-91c6-4b2d22e82728" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa28b7e-f0ec-44d9-b095-9b05452fddef]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:30 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 Jul 08 19:52:30 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:30 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.760s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Deleted volume successfully. Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6b05b67a-6711-4c1e-b730-8df462571804 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-7cc3c08d-f361-4706-a3f5-3d357eef1f37-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:30 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 1073741824" returned: 0 in 1.144s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:30 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:30 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:31 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728" returned: 0 in 1.049s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:31 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728 Jul 08 19:52:31 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (67e4156b-d708-418d-a196-1c56e8ec4606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58c619f-251f-4814-8be2-ac4917a31ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58c619f-251f-4814-8be2-ac4917a31ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4402479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26a4eae-fcb9-4fd3-8a72-9358b3485ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:31Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1678dd-cf1a-46c3-8d5a-e8d60c099aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1678dd-cf1a-46c3-8d5a-e8d60c099aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc897be-3707-49cd-803d-aa51aae2db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc897be-3707-49cd-803d-aa51aae2db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26a4eae-fcb9-4fd3-8a72-9358b3485ed5', 'volume_name': 'volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b0f6e9-490f-42c0-9f65-207f56ecd3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b0f6e9-490f-42c0-9f65-207f56ecd3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06fb3d0-ee5e-4f32-bdd1-4d103b2fcba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:31 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume b26a4eae-fcb9-4fd3-8a72-9358b3485ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5', 'volume_size': 1} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:31 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 0 in 0.884s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.174s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4402479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26a4eae-fcb9-4fd3-8a72-9358b3485ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:31Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating volume b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:31 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Attempting download of 6f5008d3-46da-40e6-bdf3-2bc7c50481cf ((None, [{'url': 'file:///opt/stack/data/glance/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'metadata': {}}])) to volume 0bc359d7-2dc7-48bc-8d38-3fa567749da9. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:52:31 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 1073741824 Jul 08 19:52:31 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b940aea-5bbd-461b-96eb-8e91fcd715ab]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:32 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec Jul 08 19:52:32 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (01d5f228-b632-43aa-a4f0-5e6d548ca390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6c4204-17d8-4b9d-846e-9f4c1f72d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6c4204-17d8-4b9d-846e-9f4c1f72d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-291845480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fdac23-f4e5-4087-8eb4-14fdd43b968c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:32Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcdb84f-e21b-4e23-9a77-e409a5d6a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcdb84f-e21b-4e23-9a77-e409a5d6a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8eec44-3ceb-4b7b-826f-9bd0088c8ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8eec44-3ceb-4b7b-826f-9bd0088c8ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fdac23-f4e5-4087-8eb4-14fdd43b968c', 'volume_name': 'volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6a2ff3-2e07-4f2d-a015-a3093c28fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6a2ff3-2e07-4f2d-a015-a3093c28fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fcf6cd-6da8-40e0-bc01-16d0c0af6634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume 58fdac23-f4e5-4087-8eb4-14fdd43b968c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c', 'volume_size': 1} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:32 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8517c1f9-d940-403d-91c6-4b2d22e82728" returned: 0 in 1.128s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-8517c1f9-d940-403d-91c6-4b2d22e82728" released by "delete_volume" :: held 2.245s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (4429a942-8969-4dcf-837b-badd76e3b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7675a34-248f-421d-b20f-3b83c8b0e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created reservations ['75756d11-e3fe-4fa6-bd6b-9dba979d4297', 'fdf3eb99-0878-4c34-99de-973d20dbb57b', 'f468dac0-bef4-4f19-8fdd-fd0d658bf58a', '404169a8-3c21-41cd-b009-5220fe8714d6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7675a34-248f-421d-b20f-3b83c8b0e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654306477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f84ad4-d3d2-4eef-aa57-2921534c5d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:32Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d300cc29-3fdf-4bc8-91d7-8ce01d174203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d300cc29-3fdf-4bc8-91d7-8ce01d174203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49495a77-cc1b-4a34-93d3-c39cdcd6a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49495a77-cc1b-4a34-93d3-c39cdcd6a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f84ad4-d3d2-4eef-aa57-2921534c5d7a', 'volume_name': 'volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2cf9ca-9540-49d6-aa21-708a70b36b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2cf9ca-9540-49d6-aa21-708a70b36b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab0ca09-fb78-41fe-9573-f86dce784244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:32 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume e6f84ad4-d3d2-4eef-aa57-2921534c5d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a', 'volume_size': 1} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:32 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:32 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:33 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec" returned: 0 in 1.303s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (1302b7c8-eea4-4c09-a65c-5d2da5bfaddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595c5d23-c929-4a1b-a2e3-daaf41f101a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec Jul 08 19:52:33 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595c5d23-c929-4a1b-a2e3-daaf41f101a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304223418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c7b620-07d0-40fd-a176-1ca4f794620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:33Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e589542-4b91-46ea-a98c-9dbcb45dfdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e589542-4b91-46ea-a98c-9dbcb45dfdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a018dbd-758d-402e-83b5-43f69df5a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a018dbd-758d-402e-83b5-43f69df5a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c7b620-07d0-40fd-a176-1ca4f794620a', 'volume_name': 'volume-93c7b620-07d0-40fd-a176-1ca4f794620a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f159354-c717-4a28-a388-4dc4b4e63565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f159354-c717-4a28-a388-4dc4b4e63565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bc8392-ca9a-494e-a7d2-e31a8f93f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume 93c7b620-07d0-40fd-a176-1ca4f794620a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c7b620-07d0-40fd-a176-1ca4f794620a', 'volume_size': 1} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 1073741824" returned: 0 in 1.758s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-d01160aa-b663-4997-9976-27e63e632be9-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:33 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 Jul 08 19:52:33 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-d01160aa-b663-4997-9976-27e63e632be9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (0db7cefa-70d5-4149-b4d0-69390532cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a42eb92-997a-4fc0-b7be-2f442f8a2916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a42eb92-997a-4fc0-b7be-2f442f8a2916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-838012270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7748797a-16d5-4f3c-9b42-486508ce5b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:34Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbd4202-b001-4bea-9ff5-2fc14d30284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbd4202-b001-4bea-9ff5-2fc14d30284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f5806c-0381-4c36-854d-e95878910458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f5806c-0381-4c36-854d-e95878910458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7748797a-16d5-4f3c-9b42-486508ce5b43', 'volume_name': 'volume-7748797a-16d5-4f3c-9b42-486508ce5b43', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e36674c-cb85-4f5a-a0c8-abe14da266b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e36674c-cb85-4f5a-a0c8-abe14da266b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31bab1e-7b3d-45c0-87d5-e840ed9e395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:33 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume 7748797a-16d5-4f3c-9b42-486508ce5b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7748797a-16d5-4f3c-9b42-486508ce5b43', 'volume_size': 1} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-quobyte-d01160aa-b663-4997-9976-27e63e632be9" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-d01160aa-b663-4997-9976-27e63e632be9" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1339652-6a24-40a5-8b01-15c4dd8874e3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:33 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.118s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:33 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Deleted volume successfully. Jul 08 19:52:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4648d1c1-ee5b-40b0-82b2-62379e6f76a4 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-8517c1f9-d940-403d-91c6-4b2d22e82728-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:33 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 Jul 08 19:52:33 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-84d0b5ba-7017-4e76-b951-5958b2d90493 tempest-ProjectAdminTests-1511901363 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87172) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4840}} Jul 08 19:52:34 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec" returned: 1 in 0.969s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_rsfq8vec' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fab1e43-6c7d-4b85-b9e6-b8b33d2e0c13]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:34 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD Jul 08 19:52:34 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:34 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5" returned: 0 in 0.773s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] <== create_volume: return (2614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-291845480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fdac23-f4e5-4087-8eb4-14fdd43b968c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:32Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating volume 58fdac23-f4e5-4087-8eb4-14fdd43b968c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:34 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06fb3d0-ee5e-4f32-bdd1-4d103b2fcba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ab8ef9-aac6-4c7d-9d9e-89b536dd2f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:34 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c 1073741824 Jul 08 19:52:34 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 (b26a4eae-fcb9-4fd3-8a72-9358b3485ed5): created successfully Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ab8ef9-aac6-4c7d-9d9e-89b536dd2f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (67e4156b-d708-418d-a196-1c56e8ec4606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-379bb9a6-266c-4984-b3d4-bf795a64ffcb tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created volume successfully. Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:34 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:34 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:34 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9" returned: 0 in 0.942s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:34 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9 Jul 08 19:52:34 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:35 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:35 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD Jul 08 19:52:35 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:35 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.838s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:52:35 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c 1073741824" returned: 0 in 1.228s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:35 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c Jul 08 19:52:35 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:35 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-d01160aa-b663-4997-9976-27e63e632be9" returned: 0 in 0.865s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-d01160aa-b663-4997-9976-27e63e632be9" released by "delete_volume" :: held 1.866s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created reservations ['7bccae11-5390-472c-a417-95b946e5ec91', 'fac7effa-1a76-498a-abab-50bc4519ee58', 'a6bef7fa-468c-469a-8094-aadef10acaaa', '453a6125-86d9-407d-8871-fb7e100f4b81'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:35 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:35 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-05812fc5-6d55-4827-be86-eaf4e698640a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-05812fc5-6d55-4827-be86-eaf4e698640a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-quobyte-05812fc5-6d55-4827-be86-eaf4e698640a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-05812fc5-6d55-4827-be86-eaf4e698640a" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d8782d-b61c-4915-b245-722321592956]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:36 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD" returned: 1 in 1.184s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] 6f5008d3-46da-40e6-bdf3-2bc7c50481cf was raw, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:36 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:36 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:36 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a Jul 08 19:52:36 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:36 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c" returned: 0 in 1.046s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.036s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654306477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f84ad4-d3d2-4eef-aa57-2921534c5d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:32Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating volume e6f84ad4-d3d2-4eef-aa57-2921534c5d7a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:36 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fcf6cd-6da8-40e0-bc01-16d0c0af6634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:36 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a 1073741824 Jul 08 19:52:36 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994c614b-7dd3-4e55-8cdc-b5372fc55f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:36 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c (58fdac23-f4e5-4087-8eb4-14fdd43b968c): created successfully Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994c614b-7dd3-4e55-8cdc-b5372fc55f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:36 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (01d5f228-b632-43aa-a4f0-5e6d548ca390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.932s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Deleted volume successfully. Jul 08 19:52:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bbd601bc-d299-430e-a485-3ec7a993eb9b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created volume successfully. Jul 08 19:52:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-49b85133-1acf-4293-a82a-dca13ddc12e9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-d01160aa-b663-4997-9976-27e63e632be9-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:37 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a" returned: 0 in 1.089s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:37 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 0 in 1.002s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6f5008d3-46da-40e6-bdf3-2bc7c50481cf_038mf3_kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:52:37 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:37 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a Jul 08 19:52:37 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:37 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 1G Jul 08 19:52:37 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:37 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a 1073741824" returned: 0 in 1.148s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:37 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a Jul 08 19:52:37 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:38 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-05812fc5-6d55-4827-be86-eaf4e698640a" returned: 0 in 0.764s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-05812fc5-6d55-4827-be86-eaf4e698640a" released by "delete_volume" :: held 1.919s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:38 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 1G" returned: 0 in 0.812s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created reservations ['e618b4c4-5516-437a-b549-bfc186bbe60c', 'e9cca2f9-27ea-4ee0-9a61-da7780a50a30', '83679465-2d4c-402a-8486-0e7626a1e1f1', '6d8538c1-0e99-4f62-9582-c1d019be157f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfee915-0ea3-49f7-9051-1d624c0aa006]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:38 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:38 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:38 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:38 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-299bed51-f8a4-442f-91ed-9507bfe3fa93-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-299bed51-f8a4-442f-91ed-9507bfe3fa93-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "cinder-quobyte-299bed51-f8a4-442f-91ed-9507bfe3fa93" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-299bed51-f8a4-442f-91ed-9507bfe3fa93" acquired by "delete_volume" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c776d34-77e8-4834-8b2c-589bf8551a41]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:38 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 Jul 08 19:52:38 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:38 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a" returned: 0 in 0.992s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.424s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304223418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c7b620-07d0-40fd-a176-1ca4f794620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:33Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating volume 93c7b620-07d0-40fd-a176-1ca4f794620a {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:38 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:38 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab0ca09-fb78-41fe-9573-f86dce784244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d607a00-2288-47f0-b976-4fed75cf6ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:39 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a 1073741824 Jul 08 19:52:39 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:39 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a (e6f84ad4-d3d2-4eef-aa57-2921534c5d7a): created successfully Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d607a00-2288-47f0-b976-4fed75cf6ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (4429a942-8969-4dcf-837b-badd76e3b38c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-230b46ba-bdec-4142-95ac-ec20d182f81f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created volume successfully. Jul 08 19:52:39 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.888s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Deleted volume successfully. Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-109f9af8-6f48-4963-816c-a54eb4ca72c0 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-05812fc5-6d55-4827-be86-eaf4e698640a-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:39 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 0 in 1.091s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:39 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:39 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:39 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93" returned: 0 in 1.115s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:39 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93 Jul 08 19:52:39 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (2de3cf39-a74c-4352-8f45-0ee2b48b8747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f157a842-e4e1-4ef5-b98d-2f17a9152cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f157a842-e4e1-4ef5-b98d-2f17a9152cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427160983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9c00b9-fceb-4b69-90f9-883f1d393d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:40Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06af084-fd3d-4b20-a5a6-ddb9d4789d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06af084-fd3d-4b20-a5a6-ddb9d4789d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d085f859-5ee2-4159-9439-4307c3024c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d085f859-5ee2-4159-9439-4307c3024c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af9c00b9-fceb-4b69-90f9-883f1d393d84', 'volume_name': 'volume-af9c00b9-fceb-4b69-90f9-883f1d393d84', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8249c1-ba8f-46b9-bc9c-f474dad92fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8249c1-ba8f-46b9-bc9c-f474dad92fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b19045-e41d-40d4-8e56-645e6cdb311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:39 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Volume af9c00b9-fceb-4b69-90f9-883f1d393d84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af9c00b9-fceb-4b69-90f9-883f1d393d84', 'volume_size': 1} Jul 08 19:52:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:40 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a 1073741824" returned: 0 in 1.090s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:40 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a Jul 08 19:52:40 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:40 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 1 in 0.938s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Downloaded image 6f5008d3-46da-40e6-bdf3-2bc7c50481cf ((None, [{'url': 'file:///opt/stack/data/glance/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'metadata': {}}])) to volume 0bc359d7-2dc7-48bc-8d38-3fa567749da9 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Temporary image 6f5008d3-46da-40e6-bdf3-2bc7c50481cf for user 7a2010bca1944385b539f45146b37cd5 is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Marking volume 0bc359d7-2dc7-48bc-8d38-3fa567749da9 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Copying metadata from image 6f5008d3-46da-40e6-bdf3-2bc7c50481cf to 0bc359d7-2dc7-48bc-8d38-3fa567749da9. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Creating volume glance metadata for volume 0bc359d7-2dc7-48bc-8d38-3fa567749da9 backed by image 6f5008d3-46da-40e6-bdf3-2bc7c50481cf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ab02c35e2ba1c1afcdd22d809cfe5a18', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24333b44-d382-4c08-acda-5f5950970a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9', 'volume_size': 1, 'image_id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ab02c35e2ba1c1afcdd22d809cfe5a18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4d04bd255db4b8497716423ae941cc1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ebb6a0cb722912a8b6a9367ffe5080bfed9912697d54843a36240c08448d1da00d5708282cec0e643c4980e78f303e59816a47e8bae7c98eb18ddf63c8b9657', 'id': '6f5008d3-46da-40e6-bdf3-2bc7c50481cf', 'created_at': datetime.datetime(2026, 7, 8, 17, 52, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 52, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6f5008d3-46da-40e6-bdf3-2bc7c50481cf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f83bffe-aba7-42ee-a880-0126bbea155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:40 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Volume volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 (0bc359d7-2dc7-48bc-8d38-3fa567749da9): created successfully Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f83bffe-aba7-42ee-a880-0126bbea155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Flow 'volume_create_manager' (26619a3b-1ca1-43c0-833f-fd03457c84d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-67cc509c-1b01-4b86-85dc-cc987b176c1b tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Created volume successfully. Jul 08 19:52:40 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-299bed51-f8a4-442f-91ed-9507bfe3fa93" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-quobyte-299bed51-f8a4-442f-91ed-9507bfe3fa93" released by "delete_volume" :: held 1.966s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Created reservations ['55693502-8ecb-426f-ab03-06e1417ca962', 'ff33a350-2f9b-4efc-a7ff-8104efe760ce', '95897b2d-9430-44d0-927c-a1e3f7ba95fe', '698db2b9-3606-4fae-9b6d-d5fe842224eb'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:40 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:40 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:40 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.983s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-838012270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7748797a-16d5-4f3c-9b42-486508ce5b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ccd91f396e4a12be57cd88ac963b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:34Z,use_quota=True,user_id='f004600ad9074afd95730566621b8d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Creating volume 7748797a-16d5-4f3c-9b42-486508ce5b43 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:40 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bc8392-ca9a-494e-a7d2-e31a8f93f70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c7b620-07d0-40fd-a176-1ca4f794620a', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d143dea-849a-4ad0-88da-0adb1d4b8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:40 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 1073741824 Jul 08 19:52:40 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:40 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume volume-93c7b620-07d0-40fd-a176-1ca4f794620a (93c7b620-07d0-40fd-a176-1ca4f794620a): created successfully Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d143dea-849a-4ad0-88da-0adb1d4b8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:40 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (1302b7c8-eea4-4c09-a65c-5d2da5bfaddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:40 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b854e78c-0bbd-4021-99d2-07318809f87f tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created volume successfully. Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Acquiring lock "cinder-0bc359d7-2dc7-48bc-8d38-3fa567749da9-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "cinder-0bc359d7-2dc7-48bc-8d38-3fa567749da9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Acquiring lock "cinder-quobyte-0bc359d7-2dc7-48bc-8d38-3fa567749da9" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "cinder-quobyte-0bc359d7-2dc7-48bc-8d38-3fa567749da9" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3424c-7c8a-43ea-849c-fe4121f0ccf6]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:41 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:41 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:41 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.861s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Deleted volume successfully. Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-01dd1d6f-b8b0-4b87-a497-29e4cdc87cd9 tempest-CreateVolumesFromSourceVolumeTest-129207503 None] Lock "cinder-299bed51-f8a4-442f-91ed-9507bfe3fa93-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:41 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 1073741824" returned: 0 in 1.010s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:41 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 Jul 08 19:52:41 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:42 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 0 in 0.958s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:42 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:42 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:42 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43" returned: 0 in 0.722s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.651s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427160983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af9c00b9-fceb-4b69-90f9-883f1d393d84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:40Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Creating volume af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:42 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:42 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 1073741824 Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31bab1e-7b3d-45c0-87d5-e840ed9e395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7748797a-16d5-4f3c-9b42-486508ce5b43', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:42 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cac3ee9-f473-4048-9764-c328f26b69a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:42 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Volume volume-7748797a-16d5-4f3c-9b42-486508ce5b43 (7748797a-16d5-4f3c-9b42-486508ce5b43): created successfully Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cac3ee9-f473-4048-9764-c328f26b69a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Flow 'volume_create_manager' (0db7cefa-70d5-4149-b4d0-69390532cc36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:42 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c2f156d4-7b2c-4398-acbd-2bc96f9adcde tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created volume successfully. Jul 08 19:52:43 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 1 in 0.806s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:43 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9 Jul 08 19:52:43 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:43 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 1073741824" returned: 0 in 0.976s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:43 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 Jul 08 19:52:43 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-7748797a-16d5-4f3c-9b42-486508ce5b43-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-7748797a-16d5-4f3c-9b42-486508ce5b43-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-7748797a-16d5-4f3c-9b42-486508ce5b43" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-7748797a-16d5-4f3c-9b42-486508ce5b43" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7c568b-3503-4fec-819d-26d6731ed3d9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:43 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0bc359d7-2dc7-48bc-8d38-3fa567749da9" returned: 0 in 0.827s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:43 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "cinder-quobyte-0bc359d7-2dc7-48bc-8d38-3fa567749da9" released by "delete_volume" :: held 2.694s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Created reservations ['dc181740-77c6-42ab-bebe-f98eb1c16090', 'ec46e6f3-7f37-4374-9367-7594b4bda53d', '505c455d-372e-4f5d-b0b6-fc2a919b9a92', 'd5808ef4-a00f-4140-9e5f-6b395091c92f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:44 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 Jul 08 19:52:44 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:44 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:44 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:44 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Flow 'volume_create_manager' (4c85e26a-b51d-4f84-817f-1fca27e053a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4554a945-93da-4056-9051-e5e0991d55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84" returned: 0 in 0.854s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4554a945-93da-4056-9051-e5e0991d55e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1435795999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f41be0-6f31-4ce4-9706-5ea7e7ea950d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b7064431b146e099b8909da15ca668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:44Z,use_quota=True,user_id='5db155569e2542a5b4300dbda11d0409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03666711-2357-419a-968a-ecdc7a6794a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03666711-2357-419a-968a-ecdc7a6794a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849aabbf-e0c3-4a8e-920c-99d5c219d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849aabbf-e0c3-4a8e-920c-99d5c219d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f41be0-6f31-4ce4-9706-5ea7e7ea950d', 'volume_name': 'volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc76abfa-3d3c-4372-8fe4-f60292625230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc76abfa-3d3c-4372-8fe4-f60292625230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c45d76-84bc-4eb3-90c3-2d85ec128fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Volume c4f41be0-6f31-4ce4-9706-5ea7e7ea950d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d', 'volume_size': 1} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1435795999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f41be0-6f31-4ce4-9706-5ea7e7ea950d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b7064431b146e099b8909da15ca668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:44Z,use_quota=True,user_id='5db155569e2542a5b4300dbda11d0409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Creating volume c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:44 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b19045-e41d-40d4-8e56-645e6cdb311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af9c00b9-fceb-4b69-90f9-883f1d393d84', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c15f4e-e95f-4d4c-9011-c57aa453d8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:44 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d 1073741824 Jul 08 19:52:44 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Volume volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 (af9c00b9-fceb-4b69-90f9-883f1d393d84): created successfully Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c15f4e-e95f-4d4c-9011-c57aa453d8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (2de3cf39-a74c-4352-8f45-0ee2b48b8747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-eb49d350-a319-4f2e-b73a-adef2b0a2ae0 tempest-ProjectReaderTests-1609370007 None] Created volume successfully. Jul 08 19:52:44 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.802s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:44 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Deleted volume successfully. Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4df3e2c4-a95d-4355-b656-c1ee2faeae54 tempest-VolumeAndVolumeTypeFromImageTest-927781642 None] Lock "cinder-0bc359d7-2dc7-48bc-8d38-3fa567749da9-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:45 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43" returned: 0 in 1.171s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:45 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43 Jul 08 19:52:45 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:45 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d 1073741824" returned: 0 in 1.126s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:45 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:52:45 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:45 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-7748797a-16d5-4f3c-9b42-486508ce5b43" returned: 0 in 0.819s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-7748797a-16d5-4f3c-9b42-486508ce5b43" released by "delete_volume" :: held 2.031s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:45 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['28e33acb-eca4-4e03-8f16-018f9ba80ab7', '16aea292-a72c-48f7-a8d9-da756e94fd48', '27c7f31a-5186-41ec-8ba8-7ffc8336f223', 'd40800a6-eb25-49a5-b3d3-6abea7dd692e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:46 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:46 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:46 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 0.707s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.914s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c45d76-84bc-4eb3-90c3-2d85ec128fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19f75e5-bf57-4116-af38-a53449528aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Creating offline snapshot 37b6175c-302c-4d37-b7cc-6da95c63a7f5 of volume af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:52:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Volume volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d (c4f41be0-6f31-4ce4-9706-5ea7e7ea950d): created successfully Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19f75e5-bf57-4116-af38-a53449528aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Flow 'volume_create_manager' (4c85e26a-b51d-4f84-817f-1fca27e053a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf68666-3bdc-4323-bd73-f033ea210aa2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f6bea6de-c3a8-41b2-97bb-2a7c32139edf tempest-VolumeDependencyTests-2107177615 None] Created volume successfully. Jul 08 19:52:46 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 Jul 08 19:52:46 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:46 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.823s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleted volume successfully. Jul 08 19:52:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ea604e3c-1d14-4bdc-a9f1-9d6f53029231 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-7748797a-16d5-4f3c-9b42-486508ce5b43-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-93c7b620-07d0-40fd-a176-1ca4f794620a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-93c7b620-07d0-40fd-a176-1ca4f794620a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-93c7b620-07d0-40fd-a176-1ca4f794620a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-93c7b620-07d0-40fd-a176-1ca4f794620a" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b5d192-1183-4016-8915-35139fdeb094]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:47 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a Jul 08 19:52:47 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:47 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84" returned: 0 in 0.897s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:47 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 1G Jul 08 19:52:47 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:48 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a" returned: 0 in 0.871s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:48 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a Jul 08 19:52:48 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:48 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 1G" returned: 0 in 1.003s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:48 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 Jul 08 19:52:48 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:48 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-93c7b620-07d0-40fd-a176-1ca4f794620a" returned: 0 in 0.694s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-93c7b620-07d0-40fd-a176-1ca4f794620a" released by "delete_volume" :: held 1.621s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['3101e077-0801-49c1-b860-9916f7a7f445', 'd4c9df62-38eb-46d3-be23-285cbaa79b58', 'aa1a10c2-9713-48cb-a48a-913e18c8f502', 'f65b6228-e6a6-4d7f-b3fc-356a15528e7f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:49 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:49 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:49 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5" returned: 0 in 0.807s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:49 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 is being set with open permissions: ugo+rw Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:49 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 Jul 08 19:52:49 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce7bdd-217b-460c-b3f1-1aa4fe9b4997]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:49 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.713s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleted volume successfully. Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e312c975-4b7c-4b35-8448-bc5fe6b4f535 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-93c7b620-07d0-40fd-a176-1ca4f794620a-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:49 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a Jul 08 19:52:49 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Flow 'volume_create_manager' (b3a57ea5-5aaa-4b50-b81a-d861969253b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b53fc8d-1321-4bda-a3e4-ade1a515078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b53fc8d-1321-4bda-a3e4-ade1a515078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50faa69-99ed-45cc-b550-b0e853b2c406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0563254ed448a584df3c8c0a44b63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:50Z,use_quota=True,user_id='0c20093035d5438f85c6e52a8dce1799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd53af6-9b5f-4999-95b8-cde2cc6e3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd53af6-9b5f-4999-95b8-cde2cc6e3d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d775de4a-227d-4e39-b0ad-eb3aed9b341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d775de4a-227d-4e39-b0ad-eb3aed9b341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50faa69-99ed-45cc-b550-b0e853b2c406', 'volume_name': 'volume-e50faa69-99ed-45cc-b550-b0e853b2c406', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2349c71-0e08-4e34-9ac8-0fcd8afb685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2349c71-0e08-4e34-9ac8-0fcd8afb685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4862df-ea98-4b08-a1bc-b504734c4277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:49 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Volume e50faa69-99ed-45cc-b550-b0e853b2c406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50faa69-99ed-45cc-b550-b0e853b2c406', 'volume_size': 1} Jul 08 19:52:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:50 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5" returned: 0 in 0.875s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:50 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info Jul 08 19:52:50 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:50 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a" returned: 0 in 0.853s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:50 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a Jul 08 19:52:50 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:50 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info" returned: 0 in 0.703s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:50 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info is being set with open permissions: ugo+rw Jul 08 19:52:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:50 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info Jul 08 19:52:50 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:51 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a" returned: 0 in 0.627s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a" released by "delete_volume" :: held 1.528s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['7bd1bd19-d257-4868-bdb9-2a655f71dc96', '364d01af-4f28-4c96-8208-a60ab4a4aabd', '3bc63016-8435-4632-a380-fd29cf970623', '6fa5d9de-b119-4992-ba7e-77f76d7c0aea'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:51 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:51 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:51 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.info" returned: 0 in 0.683s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.081s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.658s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Creating offline snapshot 0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 of volume c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:52:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-06519842-b058-423d-b750-b898368cf6aa tempest-ProjectReaderTests-1609370007 None] Create snapshot completed successfully Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d6f509-5d1d-42fb-92ae-5fa0ca946b4c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-58fdac23-f4e5-4087-8eb4-14fdd43b968c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:51 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:52:51 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-58fdac23-f4e5-4087-8eb4-14fdd43b968c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-58fdac23-f4e5-4087-8eb4-14fdd43b968c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-58fdac23-f4e5-4087-8eb4-14fdd43b968c" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:51 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.701s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4965e55-8309-48cf-940e-a561d455b1b5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleted volume successfully. Jul 08 19:52:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-80160bbc-3997-4b24-bc91-60e3a380a39b tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-e6f84ad4-d3d2-4eef-aa57-2921534c5d7a-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:52 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c Jul 08 19:52:52 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-37b6175c-302c-4d37-b7cc-6da95c63a7f5-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Lock "cinder-37b6175c-302c-4d37-b7cc-6da95c63a7f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-af9c00b9-fceb-4b69-90f9-883f1d393d84" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-af9c00b9-fceb-4b69-90f9-883f1d393d84" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-37b6175c-302c-4d37-b7cc-6da95c63a7f5" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-37b6175c-302c-4d37-b7cc-6da95c63a7f5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Deleting offline snapshot 37b6175c-302c-4d37-b7cc-6da95c63a7f5 of volume af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] snapshot_file for this snap is: volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf409b-7e53-4691-93ad-0d82200fb9b3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:52 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 Jul 08 19:52:52 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:52 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 1.064s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:52 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 1G Jul 08 19:52:52 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:52 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c" returned: 0 in 0.863s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:52 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c Jul 08 19:52:52 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:53 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5" returned: 0 in 0.863s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af9c00b9-fceb-4b69-90f9-883f1d393d84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[67554a2a-1733-473f-aa38-cc940c9cead1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:53 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 Jul 08 19:52:53 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:53 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-58fdac23-f4e5-4087-8eb4-14fdd43b968c" returned: 0 in 0.679s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-58fdac23-f4e5-4087-8eb4-14fdd43b968c" released by "delete_volume" :: held 1.609s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['f539ac03-ffdc-4b6c-916a-a1c166c2e25d', 'b8eb21ca-a448-4ebe-b4c9-50d4e313548a', '79a5b3cb-1d1b-4bc7-a50c-53adb28820e6', '4ded967f-eb0c-467c-b5aa-a61e4a94bf56'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:53 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 1G" returned: 0 in 0.949s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:53 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:53 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:53 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 Jul 08 19:52:53 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:53 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84" returned: 0 in 0.832s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:53 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 Jul 08 19:52:53 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58882ff-8638-4629-9d69-b87d27588e56]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:54 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.706s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleted volume successfully. Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-23c8de57-46db-4eac-89f6-f6b55c4013ef tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-58fdac23-f4e5-4087-8eb4-14fdd43b968c-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:54 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:54 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 Jul 08 19:52:54 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:54 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 is being set with open permissions: ugo+rw Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:54 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 Jul 08 19:52:54 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:54 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5" returned: 0 in 0.868s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:54 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5 Jul 08 19:52:54 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:55 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5" returned: 0 in 0.790s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:55 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5 Jul 08 19:52:55 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:55 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" returned: 0 in 0.671s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:55 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info Jul 08 19:52:55 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:55 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84.37b6175c-302c-4d37-b7cc-6da95c63a7f5" returned: 0 in 0.818s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-37b6175c-302c-4d37-b7cc-6da95c63a7f5" released by "_delete_snapshot" :: held 3.489s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-af9c00b9-fceb-4b69-90f9-883f1d393d84" released by "delete_snapshot" :: held 3.519s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=137,cinder:UPDATE=185,cinder:INSERT=48,cinder:DELETE=25 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Created reservations ['f6068b63-4ba6-41c6-8087-ad7ae96f3ac7', 'f749dceb-7bff-4050-ade8-e6bb85e8961e', '11f56155-8ef3-43fd-9c8d-6191f507e7a6', 'f2012c92-917c-42ee-9fff-702db48012ae'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:55 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5" returned: 0 in 0.683s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5" released by "delete_volume" :: held 1.524s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:55 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info" returned: 0 in 0.695s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:55 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info is being set with open permissions: ugo+rw Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:55 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Delete snapshot completed successfully. Jul 08 19:52:55 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef6b868e-b19b-4ed9-8fa9-f589bfd41d4e tempest-ProjectReaderTests-1609370007 None] Lock "cinder-37b6175c-302c-4d37-b7cc-6da95c63a7f5-delete_snapshot" released by "delete_snapshot" :: held 3.734s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:55 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['46e501de-01f2-43f0-81d3-119739690a94', '1af6cad0-3308-4a07-9b77-e2c83b7d660d', '59e98c6b-51e6-4450-95aa-ff41adc65201', 'a9e8d9c5-ed5e-4fb2-8f98-701e121c19a1'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:55 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:55 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-af9c00b9-fceb-4b69-90f9-883f1d393d84-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-766fdf50-c5b8-47c0-a43e-4e54136fd4cb-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-af9c00b9-fceb-4b69-90f9-883f1d393d84-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-766fdf50-c5b8-47c0-a43e-4e54136fd4cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-766fdf50-c5b8-47c0-a43e-4e54136fd4cb" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=152,cinder:UPDATE=216,cinder:INSERT=54,cinder:DELETE=13 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:52:56 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-af9c00b9-fceb-4b69-90f9-883f1d393d84" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.info" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.988s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-766fdf50-c5b8-47c0-a43e-4e54136fd4cb" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleting offline snapshot 766fdf50-c5b8-47c0-a43e-4e54136fd4cb of volume 0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] snapshot_file for this snap is: volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.561s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50faa69-99ed-45cc-b550-b0e853b2c406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0563254ed448a584df3c8c0a44b63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:50Z,use_quota=True,user_id='0c20093035d5438f85c6e52a8dce1799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Creating volume e50faa69-99ed-45cc-b550-b0e853b2c406 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:56 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35bc99-37a4-4a0c-a805-d997b5653810]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:56 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 1073741824 Jul 08 19:52:56 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-af9c00b9-fceb-4b69-90f9-883f1d393d84" acquired by "delete_volume" :: waited 0.116s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:56 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b35b659c-60a8-4179-9b71-44a1934f5dc3 tempest-VolumeDependencyTests-2107177615 None] Create snapshot completed successfully Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3421db-691f-4550-b941-3174fe08f77a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:56 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.806s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:56 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleted volume successfully. Jul 08 19:52:56 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb Jul 08 19:52:56 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-d5fad7ac-3d92-4af4-aa44-9b568c14fb2a tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-b26a4eae-fcb9-4fd3-8a72-9358b3485ed5-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:56 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 Jul 08 19:52:56 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:57 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb" returned: 0 in 0.905s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:52:57 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd685b-c67c-4d55-97c3-f733d2ff8e9a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 1073741824" returned: 0 in 0.966s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:57 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84" returned: 0 in 0.877s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:57 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84 Jul 08 19:52:57 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:57 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 Jul 08 19:52:57 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:57 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 Jul 08 19:52:57 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Flow 'volume_create_manager' (b038fc23-fc26-4c07-9c59-4f445d27607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15174415-6a5b-4fb4-90a7-ce0aca39e222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15174415-6a5b-4fb4-90a7-ce0aca39e222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1494811320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3baf45-1f26-49b7-81a3-9a5114b6d011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b7064431b146e099b8909da15ca668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e5a1a33-5a2b-44ad-962e-37c9b6494ec2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:58Z,use_quota=True,user_id='5db155569e2542a5b4300dbda11d0409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb76146e-2504-4a81-892f-71090109bb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb76146e-2504-4a81-892f-71090109bb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64878e04-73f8-4d16-a82b-d9db1f7c887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64878e04-73f8-4d16-a82b-d9db1f7c887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd3baf45-1f26-49b7-81a3-9a5114b6d011', 'volume_name': 'volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011', 'volume_size': 1, 'snapshot_id': '0e5a1a33-5a2b-44ad-962e-37c9b6494ec2'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d74805-b7a7-498f-bcf0-52a938eefb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d74805-b7a7-498f-bcf0-52a938eefb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8c9915-a36d-439d-ba7c-0e930c0babb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Volume cd3baf45-1f26-49b7-81a3-9a5114b6d011: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011', 'volume_size': 1, 'snapshot_id': '0e5a1a33-5a2b-44ad-962e-37c9b6494ec2'} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:58 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-af9c00b9-fceb-4b69-90f9-883f1d393d84" returned: 0 in 0.796s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:58 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406" returned: 0 in 0.762s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-af9c00b9-fceb-4b69-90f9-883f1d393d84" released by "delete_volume" :: held 1.747s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.236s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-quobyte-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2-cd3baf45-1f26-49b7-81a3-9a5114b6d011" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4862df-ea98-4b08-a1bc-b504734c4277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50faa69-99ed-45cc-b550-b0e853b2c406', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a28bc7-23ea-4839-ad8a-e57796615e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2-cd3baf45-1f26-49b7-81a3-9a5114b6d011" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Creating volume cd3baf45-1f26-49b7-81a3-9a5114b6d011 from snapshot 0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-quobyte-cd3baf45-1f26-49b7-81a3-9a5114b6d011" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:52:58 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Volume volume-e50faa69-99ed-45cc-b550-b0e853b2c406 (e50faa69-99ed-45cc-b550-b0e853b2c406): created successfully Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a28bc7-23ea-4839-ad8a-e57796615e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Flow 'volume_create_manager' (b3a57ea5-5aaa-4b50-b81a-d861969253b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:58 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" returned: 0 in 0.932s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-cd3baf45-1f26-49b7-81a3-9a5114b6d011" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] snapshot: 0e5a1a33-5a2b-44ad-962e-37c9b6494ec2, volume: cd3baf45-1f26-49b7-81a3-9a5114b6d011, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:52:58 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-17793e62-d21e-4689-ac1a-2a871b187726 tempest-CinderUnicodeTest-1787805291 None] Created volume successfully. Jul 08 19:52:58 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb Jul 08 19:52:58 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eded85-7880-48fc-93fb-12cdd1705026]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Created reservations ['432db015-0e01-4962-916a-35a27384b669', 'd0766236-6a44-4e23-a7d2-2979b765e626', 'ff878270-97d5-4dd0-a1d7-55a3f94d63a8', 'b958257a-0bd0-4cc5-bcaf-64ee68223000'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:52:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:58 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 Jul 08 19:52:58 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:58 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:52:58 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (908eeb20-afed-4ec3-9405-50e16ff3a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b082a10e-a1c0-4e93-8dc2-4fa81cee31bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b082a10e-a1c0-4e93-8dc2-4fa81cee31bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956990510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b970c04-fdf5-4749-8358-c91921b228cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:59Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c290664d-c9b4-4d82-8f40-f27f8b43a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c290664d-c9b4-4d82-8f40-f27f8b43a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b18df1-a50d-47fd-a133-8420aa2f37ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b18df1-a50d-47fd-a133-8420aa2f37ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b970c04-fdf5-4749-8358-c91921b228cd', 'volume_name': 'volume-0b970c04-fdf5-4749-8358-c91921b228cd', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdde0963-36a2-400f-a37f-69b8cfa8fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdde0963-36a2-400f-a37f-69b8cfa8fe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb63ca6-7a57-4c79-8c6b-fb5781d72145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:52:59 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Volume 0b970c04-fdf5-4749-8358-c91921b228cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b970c04-fdf5-4749-8358-c91921b228cd', 'volume_size': 1} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:52:59 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb" returned: 0 in 0.917s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:59 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb Jul 08 19:52:59 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:52:59 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.785s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:52:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Deleted volume successfully. Jul 08 19:52:59 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" returned: 0 in 0.919s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7382013d-44b7-4947-a0ed-3c78c6b7f2bc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:52:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dabc0a00-255e-43bd-afce-3f532a0984e8 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-af9c00b9-fceb-4b69-90f9-883f1d393d84-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:52:59 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:52:59 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:00 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79.766fdf50-c5b8-47c0-a43e-4e54136fd4cb" returned: 0 in 0.685s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Flow 'volume_create_manager' (6e82c4f9-b4d4-4f73-abd4-7a6cf1e71243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d96b5c-1d10-4d89-bd40-de4a2ec88864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-766fdf50-c5b8-47c0-a43e-4e54136fd4cb" released by "_delete_snapshot" :: held 3.639s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" released by "delete_snapshot" :: held 3.699s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d96b5c-1d10-4d89-bd40-de4a2ec88864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1650595348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1de1052-54a1-4f34-ac72-f17f6061593f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0563254ed448a584df3c8c0a44b63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:00Z,use_quota=True,user_id='0c20093035d5438f85c6e52a8dce1799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3535eb-999c-46e8-9f34-52c72e224fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3535eb-999c-46e8-9f34-52c72e224fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e75e987-ed5c-4f50-a8b6-beada4f053ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e75e987-ed5c-4f50-a8b6-beada4f053ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1de1052-54a1-4f34-ac72-f17f6061593f', 'volume_name': 'volume-f1de1052-54a1-4f34-ac72-f17f6061593f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dce6cc9-fcc5-44b6-b1bd-404817c9a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dce6cc9-fcc5-44b6-b1bd-404817c9a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b10f14-e9fe-4dff-a24c-a0cd7bec3a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Volume f1de1052-54a1-4f34-ac72-f17f6061593f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1de1052-54a1-4f34-ac72-f17f6061593f', 'volume_size': 1} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['9e05457d-6603-491d-aea3-0bc12040a64d', 'a49bda9c-2d2f-448f-bf2b-378bf8b91609', 'b500adf1-868c-4022-b6be-8526e29e158e', '4302ef47-ad08-4ef4-a3c6-efb7a0ebd237'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:00 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 0.850s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:00 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 Jul 08 19:53:00 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:00 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Delete snapshot completed successfully. Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1ce59b41-b9a4-42ef-ac0e-1515ebd80d38 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-766fdf50-c5b8-47c0-a43e-4e54136fd4cb-delete_snapshot" released by "delete_snapshot" :: held 3.961s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "cinder-quobyte-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2633d62-75ea-47b3-acf8-ba5362ae3576]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:00 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 Jul 08 19:53:00 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:01 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" returned: 0 in 1.067s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:01 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79 Jul 08 19:53:01 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:03 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" returned: 0 in 1.268s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-quobyte-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79" released by "delete_volume" :: held 2.399s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Created reservations ['ad54af03-54bf-499a-932f-d2b3cd3a0ab3', '703fee26-73c4-4a78-b67e-e0466a224301', '2ccd7053-b403-4638-b545-7e279aeca406', '491f595b-49a4-4f41-be14-0e39b8d86783'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:03 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:03 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:04 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.475s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:04 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Deleted volume successfully. Jul 08 19:53:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-eb80752d-d94d-431d-8d28-dfd48642f160 tempest-CreateVolumesFromSnapshotTest-2046924191 None] Lock "cinder-0c2a3f52-a25d-4dad-bb05-1fc0a38fff79-delete_volume" released by "delete_volume" :: held 4.355s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:05 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011" returned: 0 in 5.217s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3877288c-bb47-4809-a022-d10bb208c5b8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:05 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:53:05 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:06 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 1.016s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:06 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:53:06 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Converted 1024.00 MB image at 196.23 MB/s Jul 08 19:53:06 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 is being set with open permissions: ugo+rw Jul 08 19:53:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:06 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 Jul 08 19:53:06 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:07 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011" returned: 0 in 0.725s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-cd3baf45-1f26-49b7-81a3-9a5114b6d011" released by "_copy_volume_from_snapshot" :: held 8.838s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2-cd3baf45-1f26-49b7-81a3-9a5114b6d011" released by "_create_volume_from_snapshot" :: held 8.901s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.939s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.029s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956990510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b970c04-fdf5-4749-8358-c91921b228cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:52:59Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Creating volume 0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:07 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:07 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd 1073741824 Jul 08 19:53:07 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8c9915-a36d-439d-ba7c-0e930c0babb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011', 'volume_size': 1, 'snapshot_id': '0e5a1a33-5a2b-44ad-962e-37c9b6494ec2'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c122c8-4717-4cc7-970e-16ecc6c47500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:07 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Volume volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 (cd3baf45-1f26-49b7-81a3-9a5114b6d011): created successfully Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c122c8-4717-4cc7-970e-16ecc6c47500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:07 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Flow 'volume_create_manager' (b038fc23-fc26-4c07-9c59-4f445d27607e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:07 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-48c4f26f-afeb-44c0-a1d8-1a38f0bf4e63 tempest-VolumeDependencyTests-2107177615 None] Created volume successfully. Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-quobyte-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-quobyte-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Deleting offline snapshot 0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 of volume c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] snapshot_file for this snap is: volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[993189ff-08d7-48c0-98db-f9808f4d7618]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:08 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 Jul 08 19:53:08 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:08 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd 1073741824" returned: 0 in 0.953s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:08 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd Jul 08 19:53:08 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:08 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" returned: 0 in 0.802s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8866257-7204-4557-88f0-1f5a81cd48c9]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:09 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd" returned: 0 in 0.719s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.817s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1650595348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1de1052-54a1-4f34-ac72-f17f6061593f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0563254ed448a584df3c8c0a44b63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:00Z,use_quota=True,user_id='0c20093035d5438f85c6e52a8dce1799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Creating volume f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:09 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:09 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:53:09 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:09 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f 1073741824 Jul 08 19:53:09 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb63ca6-7a57-4c79-8c6b-fb5781d72145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b970c04-fdf5-4749-8358-c91921b228cd', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15530c8-228b-46ef-9651-822d60bbeba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:09 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Volume volume-0b970c04-fdf5-4749-8358-c91921b228cd (0b970c04-fdf5-4749-8358-c91921b228cd): created successfully Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15530c8-228b-46ef-9651-822d60bbeba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (908eeb20-afed-4ec3-9405-50e16ff3a0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:09 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c3fd5a73-eb30-4752-b779-c345e0551b41 tempest-ProjectReaderTests-1609370007 None] Created volume successfully. Jul 08 19:53:09 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 0.822s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:09 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 Jul 08 19:53:09 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:09 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f 1073741824" returned: 0 in 0.910s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:10 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f Jul 08 19:53:10 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:10 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" returned: 0 in 0.874s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:10 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2 Jul 08 19:53:10 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:10 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f" returned: 0 in 0.768s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.358s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Creating offline snapshot 5bfdfe69-77ee-42b2-970b-5cf98810369d of volume 0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b10f14-e9fe-4dff-a24c-a0cd7bec3a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1de1052-54a1-4f34-ac72-f17f6061593f', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd178c2-99b7-46f5-ba4c-80e1863eb77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45fa7bb-5e9e-4449-a1e7-a660adefd5f0]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:10 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Volume volume-f1de1052-54a1-4f34-ac72-f17f6061593f (f1de1052-54a1-4f34-ac72-f17f6061593f): created successfully Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd178c2-99b7-46f5-ba4c-80e1863eb77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Flow 'volume_create_manager' (6e82c4f9-b4d4-4f73-abd4-7a6cf1e71243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Flow 'volume_create_manager' (43d9eb04-0896-450a-a22e-26f8e3a2439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99bdd46-3097-4e2b-a9d7-cd0560476695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-69b742fa-d9dd-4f3c-8e2d-1d61f2539e7a tempest-CinderUnicodeTest-1787805291 None] Created volume successfully. Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99bdd46-3097-4e2b-a9d7-cd0560476695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947413d4-f686-4d0e-90ee-c71ba9b38cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d1e8db4d584412addf0edad99714d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:11Z,use_quota=True,user_id='ecf099c0e7284862a200d5f062fe4508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:10 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd Jul 08 19:53:10 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72914091-39eb-4494-9e69-5efb0884a082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72914091-39eb-4494-9e69-5efb0884a082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f8ee37-9388-472a-bc3b-3806ecc0483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.image.glance [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Creating Keystone auth plugin from conf {{(pid=87172) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f8ee37-9388-472a-bc3b-3806ecc0483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '947413d4-f686-4d0e-90ee-c71ba9b38cd2', 'volume_name': 'volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2', 'volume_size': 1, 'image_id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed456c2f-b820-42d1-9621-d387da24ebd5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db97a6a92c1120ec92481c4fef4f5e50', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1d1e8db4d584412addf0edad99714d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede3d08d4018d0ad5924f4ded283e4704b976e165782108865ff347127a2e085b7cd02a45d04e7c3ae2749be6491a12072679432fc1697fbb9b1a0f352e1b7ae', 'id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'created_at': datetime.datetime(2026, 7, 8, 17, 53, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 53, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed456c2f-b820-42d1-9621-d387da24ebd5/file', 'properties': {}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63830e46-4478-4cf6-a4c0-e2d2e36f5695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63830e46-4478-4cf6-a4c0-e2d2e36f5695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c10fff-6a66-49e4-9423-d4ef6d3bd690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:11 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Volume 947413d4-f686-4d0e-90ee-c71ba9b38cd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2', 'volume_size': 1, 'image_id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed456c2f-b820-42d1-9621-d387da24ebd5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db97a6a92c1120ec92481c4fef4f5e50', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1d1e8db4d584412addf0edad99714d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede3d08d4018d0ad5924f4ded283e4704b976e165782108865ff347127a2e085b7cd02a45d04e7c3ae2749be6491a12072679432fc1697fbb9b1a0f352e1b7ae', 'id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'created_at': datetime.datetime(2026, 7, 8, 17, 53, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 53, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed456c2f-b820-42d1-9621-d387da24ebd5/file', 'properties': {}}, 'image_service': } Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Trying to clone 947413d4-f686-4d0e-90ee-c71ba9b38cd2 from image ed456c2f-b820-42d1-9621-d387da24ebd5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed456c2f-b820-42d1-9621-d387da24ebd5', 'metadata': {}}]). {{(pid=87172) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1236}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jul 08 19:53:11 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Image download 0.00 MB at 0.00 MB/s Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[add26d99-f878-4c2a-82c4-6d2a59a500af]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:11 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d.0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" returned: 0 in 0.882s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2" released by "_delete_snapshot" :: held 3.507s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" released by "delete_snapshot" :: held 3.535s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:11 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD Jul 08 19:53:11 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Created reservations ['a121adbf-dafa-4083-b07c-d6ca2bd92c7f', '2bf54acb-8779-4c4e-81cd-f6ca98a1305c', '7a78cbce-b37c-49a8-9482-64da64b24777', '6b65e50e-e42d-479d-8483-55017f456b25'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Delete snapshot completed successfully. Jul 08 19:53:11 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd" returned: 0 in 0.908s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0ea2e5dc-518b-461a-8fce-41b6d120982e tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-0e5a1a33-5a2b-44ad-962e-37c9b6494ec2-delete_snapshot" released by "delete_snapshot" :: held 3.730s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:11 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d 1G Jul 08 19:53:11 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:12 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-quobyte-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" acquired by "delete_volume" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:12 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD Jul 08 19:53:12 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b444c4-5779-4949-8e08-b1a16a14824c]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:12 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:53:12 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:12 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d 1G" returned: 0 in 0.901s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b970c04-fdf5-4749-8358-c91921b228cd -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:12 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b970c04-fdf5-4749-8358-c91921b228cd -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d Jul 08 19:53:12 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:13 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD" returned: 1 in 0.861s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Temporary image ed456c2f-b820-42d1-9621-d387da24ebd5 is fetched for user ecf099c0e7284862a200d5f062fe4508. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b31b11-b04f-4e4f-af46-a8a0e58e1efe]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:13 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD Jul 08 19:53:13 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:13 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 0.851s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:13 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:13 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d Jul 08 19:53:13 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b970c04-fdf5-4749-8358-c91921b228cd -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d" returned: 0 in 0.713s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:13 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d is being set with open permissions: ugo+rw Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:13 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d Jul 08 19:53:13 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:13 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:14 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" returned: 0 in 0.684s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d" released by "delete_volume" :: held 1.617s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:14 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d" returned: 0 in 0.718s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:14 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD Jul 08 19:53:14 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Created reservations ['00025495-22eb-4009-92ea-71fb01b4d7cf', 'f2648a9f-1f09-49eb-b3c4-ab99f6c651ed', '84217126-369d-40e5-8720-eba910fa371a', '3ab5817e-a01f-4929-af55-b52e01466c0c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:14 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info Jul 08 19:53:14 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:14 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:14 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-cd3baf45-1f26-49b7-81a3-9a5114b6d011-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-cd3baf45-1f26-49b7-81a3-9a5114b6d011-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "cinder-quobyte-cd3baf45-1f26-49b7-81a3-9a5114b6d011" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-cd3baf45-1f26-49b7-81a3-9a5114b6d011" acquired by "delete_volume" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:14 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD" returned: 1 in 0.805s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1ace29-b9f9-4219-81f7-0e5c1ce370d7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:14 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info" returned: 0 in 0.766s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:14 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info is being set with open permissions: ugo+rw Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:14 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 Jul 08 19:53:14 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:14 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info Jul 08 19:53:14 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:14 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.742s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:14 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Deleted volume successfully. Jul 08 19:53:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7154b8c3-f633-4b5f-a521-3862efe6087d tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-c4f41be0-6f31-4ce4-9706-5ea7e7ea950d-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:15 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.info" returned: 0 in 0.652s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.770s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.182s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:15 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Creating offline snapshot c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 of volume f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011" returned: 0 in 0.804s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dff3cf-7163-49ef-be50-1fd98bcde274]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:15 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011 Jul 08 19:53:15 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-13b5110e-d3ba-4244-a04d-4c923e5afa73 tempest-ProjectReaderTests-1609370007 None] Create snapshot completed successfully Jul 08 19:53:15 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f Jul 08 19:53:15 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:16 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-cd3baf45-1f26-49b7-81a3-9a5114b6d011" returned: 0 in 0.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-quobyte-cd3baf45-1f26-49b7-81a3-9a5114b6d011" released by "delete_volume" :: held 1.498s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Created reservations ['66c2e072-ed73-4406-9d16-aa1ba1054969', '57381275-7b43-427d-a6db-3cd6ad763842', '0d330fa7-8ebd-4d53-82bf-6e7f8c150cc4', 'f683a779-896f-4a09-a751-6e8fec71490b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:16 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f" returned: 0 in 0.790s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:16 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:16 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:16 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 1G Jul 08 19:53:16 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-5bfdfe69-77ee-42b2-970b-5cf98810369d-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-5bfdfe69-77ee-42b2-970b-5cf98810369d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-0b970c04-fdf5-4749-8358-c91921b228cd" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-0b970c04-fdf5-4749-8358-c91921b228cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-5bfdfe69-77ee-42b2-970b-5cf98810369d" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-5bfdfe69-77ee-42b2-970b-5cf98810369d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Deleting offline snapshot 5bfdfe69-77ee-42b2-970b-5cf98810369d of volume 0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] snapshot_file for this snap is: volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbc883a-754c-4f40-bf05-287b1aa3aeb6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:16 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d Jul 08 19:53:16 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:17 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.702s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Deleted volume successfully. Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-2fb4cf69-f8cb-492f-852b-c76a55981024 tempest-VolumeDependencyTests-2107177615 None] Lock "cinder-cd3baf45-1f26-49b7-81a3-9a5114b6d011-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:17 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 1G" returned: 0 in 0.902s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1de1052-54a1-4f34-ac72-f17f6061593f -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:17 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1de1052-54a1-4f34-ac72-f17f6061593f -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 Jul 08 19:53:17 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:17 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d" returned: 0 in 0.906s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b970c04-fdf5-4749-8358-c91921b228cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb069c8-12ea-464e-80a3-d0ff80e196af]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:17 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd Jul 08 19:53:17 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:18 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1de1052-54a1-4f34-ac72-f17f6061593f -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" returned: 0 in 0.724s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:18 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 is being set with open permissions: ugo+rw Jul 08 19:53:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:18 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 Jul 08 19:53:18 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:18 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd" returned: 0 in 0.937s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:18 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d Jul 08 19:53:18 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:18 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" returned: 0 in 0.770s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:18 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info Jul 08 19:53:18 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:19 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info" returned: 0 in 0.676s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:19 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info is being set with open permissions: ugo+rw Jul 08 19:53:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:19 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info Jul 08 19:53:19 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:19 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d" returned: 0 in 0.850s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:19 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d Jul 08 19:53:19 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:20 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.info" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.706s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.489s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947413d4-f686-4d0e-90ee-c71ba9b38cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d1e8db4d584412addf0edad99714d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:11Z,use_quota=True,user_id='ecf099c0e7284862a200d5f062fe4508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Creating volume 947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:20 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:20 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd.5bfdfe69-77ee-42b2-970b-5cf98810369d" returned: 0 in 0.737s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:20 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 1073741824 Jul 08 19:53:20 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-5bfdfe69-77ee-42b2-970b-5cf98810369d" released by "_delete_snapshot" :: held 3.569s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-0b970c04-fdf5-4749-8358-c91921b228cd" released by "delete_snapshot" :: held 3.597s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-252cc781-a796-42e8-9f18-05f908b933a1 tempest-CinderUnicodeTest-1787805291 None] Create snapshot completed successfully Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Created reservations ['ad87c5ed-6301-433a-abc3-d809255028e1', '62a0ed71-ce6b-49de-a4d0-4136605fd257', 'bc0321a5-edfe-4d8e-8a80-0c078e87c377', 'd60e2eab-a6c9-46fd-8c45-e9de0e10f96f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Delete snapshot completed successfully. Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4c425d30-f801-4401-8a9d-fbdb8903a4b6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-5bfdfe69-77ee-42b2-970b-5cf98810369d-delete_snapshot" released by "delete_snapshot" :: held 3.765s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-c6fcbdf4-3da2-4019-a6d8-27cec69e8a72-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-c6fcbdf4-3da2-4019-a6d8-27cec69e8a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-quobyte-f1de1052-54a1-4f34-ac72-f17f6061593f" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-f1de1052-54a1-4f34-ac72-f17f6061593f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-quobyte-c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Deleting offline snapshot c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 of volume f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] snapshot_file for this snap is: volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cffe85-275b-4310-aca0-771fe5b5b71f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-0b970c04-fdf5-4749-8358-c91921b228cd-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-0b970c04-fdf5-4749-8358-c91921b228cd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:21 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 Jul 08 19:53:21 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-0b970c04-fdf5-4749-8358-c91921b228cd" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-0b970c04-fdf5-4749-8358-c91921b228cd" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370ce45-b8f5-4e28-b47b-98ab60bcc465]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:21 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd Jul 08 19:53:21 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:21 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 1073741824" returned: 0 in 1.114s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:21 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:21 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:21 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" returned: 0 in 0.907s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1de1052-54a1-4f34-ac72-f17f6061593f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ede1c-34b7-40d4-9d7c-eb2db71cbd3a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:22 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f Jul 08 19:53:22 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:22 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 0 in 0.692s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:22 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd" returned: 0 in 0.930s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Attempting download of ed456c2f-b820-42d1-9621-d387da24ebd5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed456c2f-b820-42d1-9621-d387da24ebd5', 'metadata': {}}])) to volume 947413d4-f686-4d0e-90ee-c71ba9b38cd2. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 19:53:22 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd Jul 08 19:53:22 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf92b97f-9337-4ce8-ada7-affabe9178b7]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:22 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7 Jul 08 19:53:22 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:22 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f" returned: 0 in 0.995s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:22 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 Jul 08 19:53:22 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:22 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-0b970c04-fdf5-4749-8358-c91921b228cd" returned: 0 in 0.813s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-0b970c04-fdf5-4749-8358-c91921b228cd" released by "delete_volume" :: held 1.826s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Created reservations ['e8f4667c-808f-4419-8ac2-6ebdbe78af82', '0597d666-3faf-4bc5-b5c1-24cfc0f4d83e', '68e4704b-b1c8-464d-8136-7d7c1aaa7285', '50f46683-2b97-4c98-9d3b-4bc7d77a4951'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:23 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7" returned: 0 in 0.943s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:23 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:23 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:23 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7 Jul 08 19:53:23 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (c46aa30c-8e40-4e26-80f8-304817db93dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b417697d-6e47-432c-901b-0db53d6d9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b417697d-6e47-432c-901b-0db53d6d9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172449579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869c76c8-00e2-4ec0-8079-d0dd0f7eac61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:24Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3be0e-e7e3-4e5a-b52d-3aa7168b5873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3be0e-e7e3-4e5a-b52d-3aa7168b5873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6106ee-73d9-40e4-9dcd-f39f0bbc6df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6106ee-73d9-40e4-9dcd-f39f0bbc6df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869c76c8-00e2-4ec0-8079-d0dd0f7eac61', 'volume_name': 'volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0135034-eb1e-4266-a907-b0d02e072a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:23 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0135034-eb1e-4266-a907-b0d02e072a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56eb36c-42d3-4349-82ac-08ac14e5c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Volume 869c76c8-00e2-4ec0-8079-d0dd0f7eac61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61', 'volume_size': 1} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172449579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869c76c8-00e2-4ec0-8079-d0dd0f7eac61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:24Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Creating volume 869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:24 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:24 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.823s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:24 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 1073741824 Jul 08 19:53:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Deleted volume successfully. Jul 08 19:53:24 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:24 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" returned: 0 in 1.166s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a42292ce-d59f-4ad5-9cb2-75b551182712 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-0b970c04-fdf5-4749-8358-c91921b228cd-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:24 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72 Jul 08 19:53:24 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:24 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7" returned: 1 in 0.928s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed456c2f-b820-42d1-9621-d387da24ebd5_asvbgzn7' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f60734-5da3-4340-9cd6-17dc2cd4a8a4]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:24 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD Jul 08 19:53:24 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:24 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f.c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" returned: 0 in 0.839s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-c6fcbdf4-3da2-4019-a6d8-27cec69e8a72" released by "_delete_snapshot" :: held 4.055s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-f1de1052-54a1-4f34-ac72-f17f6061593f" released by "delete_snapshot" :: held 4.087s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:25 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:25 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 1073741824" returned: 0 in 1.046s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Created reservations ['5f97ec1f-a38a-4d0e-8949-355e7ac7957a', 'a3a68318-64db-4e38-8fe8-a36c9a3aa69b', 'e665a655-2a14-4c53-9b21-6ee7f188d097', 'e4e4648b-27f1-4be1-9343-83e4d3b10d9a'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Delete snapshot completed successfully. Jul 08 19:53:25 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 Jul 08 19:53:25 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf5f577-0323-44ba-a4f5-1c338dc0229b tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-c6fcbdf4-3da2-4019-a6d8-27cec69e8a72-delete_snapshot" released by "delete_snapshot" :: held 4.316s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:25 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD Jul 08 19:53:25 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:25 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" returned: 0 in 0.730s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:25 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD" returned: 1 in 0.813s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] ed456c2f-b820-42d1-9621-d387da24ebd5 was raw, converting to raw {{(pid=87172) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56eb36c-42d3-4349-82ac-08ac14e5c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:25 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:25 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d06cf4-7d3b-45e0-ad17-cc91cbeb7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:25 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Volume volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 (869c76c8-00e2-4ec0-8079-d0dd0f7eac61): created successfully Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d06cf4-7d3b-45e0-ad17-cc91cbeb7535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:25 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (c46aa30c-8e40-4e26-80f8-304817db93dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4c0bfbad-78c5-4909-8e6a-23987cf877a9 tempest-ProjectReaderTests-1609370007 None] Created volume successfully. Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-f1de1052-54a1-4f34-ac72-f17f6061593f-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-f1de1052-54a1-4f34-ac72-f17f6061593f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-quobyte-f1de1052-54a1-4f34-ac72-f17f6061593f" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-f1de1052-54a1-4f34-ac72-f17f6061593f" acquired by "delete_volume" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d1ee19-745d-4f1a-99a8-5783e725a697]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:26 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f Jul 08 19:53:26 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:26 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 0 in 0.772s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed456c2f-b820-42d1-9621-d387da24ebd5_otudmcazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:53:26 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 19:53:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:26 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 1G Jul 08 19:53:26 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:27 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f" returned: 0 in 0.890s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:27 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f Jul 08 19:53:27 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Creating offline snapshot 799a82bd-3026-4d0d-b594-2224bf4574fd of volume 869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc31e0f3-d6a5-4883-9304-33b097921fbe]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:27 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 1G" returned: 0 in 0.828s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:27 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 Jul 08 19:53:27 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a4d8d7-68d1-467b-8baa-a6ba9dfce59a]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:27 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:27 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:28 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-f1de1052-54a1-4f34-ac72-f17f6061593f" returned: 0 in 0.828s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-f1de1052-54a1-4f34-ac72-f17f6061593f" released by "delete_volume" :: held 1.797s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Created reservations ['124d5425-c451-47a0-8449-f1b039e32f5d', 'fe13a735-1663-4eb0-91b6-073a5ccd04ed', 'd6b79dd8-d5df-4b05-b893-068960a68566', 'd30473f6-89e1-4783-8144-28cd31305809'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:28 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:28 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:28 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" returned: 0 in 1.052s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:28 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:28 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd 1G Jul 08 19:53:28 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 0 in 0.991s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-e50faa69-99ed-45cc-b550-b0e853b2c406-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-e50faa69-99ed-45cc-b550-b0e853b2c406-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:28 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:28 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "cinder-quobyte-e50faa69-99ed-45cc-b550-b0e853b2c406" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-e50faa69-99ed-45cc-b550-b0e853b2c406" acquired by "delete_volume" :: waited 0.040s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f3c649-ca7d-418d-a1a4-a034362ac70f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:28 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 Jul 08 19:53:28 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:29 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 1.241s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:29 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd 1G" returned: 0 in 1.018s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:29 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Deleted volume successfully. Jul 08 19:53:29 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 1 in 0.974s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:29 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Downloaded image ed456c2f-b820-42d1-9621-d387da24ebd5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed456c2f-b820-42d1-9621-d387da24ebd5', 'metadata': {}}])) to volume 947413d4-f686-4d0e-90ee-c71ba9b38cd2 successfully. {{(pid=87172) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Temporary image ed456c2f-b820-42d1-9621-d387da24ebd5 for user ecf099c0e7284862a200d5f062fe4508 is deleted. {{(pid=87172) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.volume_utils [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Marking volume 947413d4-f686-4d0e-90ee-c71ba9b38cd2 as bootable. {{(pid=87172) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Copying metadata from image ed456c2f-b820-42d1-9621-d387da24ebd5 to 947413d4-f686-4d0e-90ee-c71ba9b38cd2. {{(pid=87172) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Creating volume glance metadata for volume 947413d4-f686-4d0e-90ee-c71ba9b38cd2 backed by image ed456c2f-b820-42d1-9621-d387da24ebd5 with: {'image_id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'db97a6a92c1120ec92481c4fef4f5e50', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87172) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-5a3213bb-66d0-49b7-8c4c-93ddb6c0eae6 tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-f1de1052-54a1-4f34-ac72-f17f6061593f-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c10fff-6a66-49e4-9423-d4ef6d3bd690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2', 'volume_size': 1, 'image_id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed456c2f-b820-42d1-9621-d387da24ebd5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db97a6a92c1120ec92481c4fef4f5e50', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c1d1e8db4d584412addf0edad99714d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ede3d08d4018d0ad5924f4ded283e4704b976e165782108865ff347127a2e085b7cd02a45d04e7c3ae2749be6491a12072679432fc1697fbb9b1a0f352e1b7ae', 'id': 'ed456c2f-b820-42d1-9621-d387da24ebd5', 'created_at': datetime.datetime(2026, 7, 8, 17, 53, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 17, 53, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed456c2f-b820-42d1-9621-d387da24ebd5/file', 'properties': {}}, 'image_service': }' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4cfd2b-7a1f-4e8d-a00b-779b7f2c8783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:29 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Volume volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 (947413d4-f686-4d0e-90ee-c71ba9b38cd2): created successfully Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4cfd2b-7a1f-4e8d-a00b-779b7f2c8783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Flow 'volume_create_manager' (43d9eb04-0896-450a-a22e-26f8e3a2439a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-585696b2-9cca-4453-992b-1b7242a22ae5 tempest-VolumeImageDependencyTests-1151379842 None] Created volume successfully. Jul 08 19:53:29 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406" returned: 0 in 1.036s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:29 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406 Jul 08 19:53:29 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:30 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd" returned: 0 in 0.802s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:30 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd is being set with open permissions: ugo+rw Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:30 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd Jul 08 19:53:30 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Acquiring lock "cinder-947413d4-f686-4d0e-90ee-c71ba9b38cd2-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Lock "cinder-947413d4-f686-4d0e-90ee-c71ba9b38cd2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Acquiring lock "cinder-quobyte-947413d4-f686-4d0e-90ee-c71ba9b38cd2" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Lock "cinder-quobyte-947413d4-f686-4d0e-90ee-c71ba9b38cd2" acquired by "delete_volume" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:30 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-e50faa69-99ed-45cc-b550-b0e853b2c406" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00e3ec-c23b-46dc-8f20-81943e815a7c]: (4, 'raw') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-quobyte-e50faa69-99ed-45cc-b550-b0e853b2c406" released by "delete_volume" :: held 1.851s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Created reservations ['1d282034-f07a-4476-87b1-0cd9a389cdd3', '57e634c7-9994-4c16-a490-983ef137935c', '4fe22e44-9238-4fb2-aea0-ff3272edcef7', '0a8980ff-7269-4dc1-a96c-33c2842ee371'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:30 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:30 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:30 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:30 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:31 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd" returned: 0 in 0.887s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:31 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info Jul 08 19:53:31 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:31 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.860s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:31 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Deleted volume successfully. Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-bb28ca91-5421-41fc-b979-e7357c6b177f tempest-CinderUnicodeTest-1787805291 None] Lock "cinder-e50faa69-99ed-45cc-b550-b0e853b2c406-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:31 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 0 in 1.197s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:31 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:31 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:32 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info" returned: 0 in 1.009s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:32 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info is being set with open permissions: ugo+rw Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:32 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info Jul 08 19:53:32 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:32 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 1 in 0.872s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2' failed. Not Retrying. {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:32 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2 Jul 08 19:53:32 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:32 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.info" returned: 0 in 0.741s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.633s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-678f6b5d-d65a-40cb-a352-fd2d54c87878 tempest-ProjectReaderTests-1609370007 None] Create snapshot completed successfully Jul 08 19:53:33 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-947413d4-f686-4d0e-90ee-c71ba9b38cd2" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Lock "cinder-quobyte-947413d4-f686-4d0e-90ee-c71ba9b38cd2" released by "delete_volume" :: held 2.883s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Created reservations ['80d3dd44-b9fb-429c-b19f-02fdfaf5d3dd', 'e443eaf7-d4d1-43e3-bc19-49e979eee6ca', 'f8233fd0-9dbb-4576-b3d6-700c4b34c5f8', '747e347c-97ab-4b6c-8be7-4062b36ae0ef'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:33 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:33 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-799a82bd-3026-4d0d-b594-2224bf4574fd-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-799a82bd-3026-4d0d-b594-2224bf4574fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-799a82bd-3026-4d0d-b594-2224bf4574fd" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-799a82bd-3026-4d0d-b594-2224bf4574fd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Deleting offline snapshot 799a82bd-3026-4d0d-b594-2224bf4574fd of volume 869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] snapshot_file for this snap is: volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4938f9a-ae17-41c4-9a5a-5984b6980b09]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:34 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd Jul 08 19:53:34 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:34 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.800s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Deleted volume successfully. Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30b5b7b1-753d-400d-8511-d900ae6afae1 tempest-VolumeImageDependencyTests-1151379842 None] Lock "cinder-947413d4-f686-4d0e-90ee-c71ba9b38cd2-delete_volume" released by "delete_volume" :: held 3.994s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:34 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:34 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:34 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd" returned: 0 in 0.971s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49cfcf-673f-4399-95ef-88fe77228ef3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:35 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 Jul 08 19:53:35 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:35 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.829s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:53:35 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" returned: 0 in 1.068s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:35 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd Jul 08 19:53:35 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:36 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd" returned: 0 in 0.861s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:36 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd Jul 08 19:53:36 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:37 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61.799a82bd-3026-4d0d-b594-2224bf4574fd" returned: 0 in 0.774s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-799a82bd-3026-4d0d-b594-2224bf4574fd" released by "_delete_snapshot" :: held 3.812s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" released by "delete_snapshot" :: held 3.841s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:37 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Created reservations ['bf326e64-60e2-484f-8bc5-b23f51403895', 'ce8dd325-95b8-4818-87ee-02187627880e', '37a7a0c5-dd07-4655-ac0f-3c3c01e65740', 'f6a1460f-bf77-4b98-9065-7209cc1cca6b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:37 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Delete snapshot completed successfully. Jul 08 19:53:37 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-30e1f951-cee3-40b9-87a0-4c72acf07dd6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-799a82bd-3026-4d0d-b594-2224bf4574fd-delete_snapshot" released by "delete_snapshot" :: held 4.023s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-869c76c8-00e2-4ec0-8079-d0dd0f7eac61-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Lock "cinder-869c76c8-00e2-4ec0-8079-d0dd0f7eac61-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:38 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be6ad0-cb08-4727-a06a-c756e31cf0f5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:38 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 Jul 08 19:53:38 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:39 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:39 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61 Jul 08 19:53:39 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:39 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" returned: 0 in 0.763s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-869c76c8-00e2-4ec0-8079-d0dd0f7eac61" released by "delete_volume" :: held 1.749s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Created reservations ['597ec1db-f2e8-49ef-a603-01e77b948081', '9d0116a3-4c38-4fb0-a924-9d79135ca085', '898c5c72-df68-4790-b39e-1f9aa3c3b008', '7e0d99d4-34be-4dd9-b2ac-d080e7768673'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:40 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:40 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (78ea346c-a54d-4dc9-9cc0-a0e0ca14833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a8fe8-3449-420b-bf00-18feda796436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:41 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.961s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Deleted volume successfully. Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a8fe8-3449-420b-bf00-18feda796436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925497117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b7321-fd67-49bc-aa07-46e3dc28c2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:41Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57222b69-4a49-4369-9f94-5f6f3c269c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57222b69-4a49-4369-9f94-5f6f3c269c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b358fc-d3ea-4034-a9ad-c0d22951f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b358fc-d3ea-4034-a9ad-c0d22951f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9b7321-fd67-49bc-aa07-46e3dc28c2a4', 'volume_name': 'volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93e44ee-8109-43e8-9634-3b2f12e86e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93e44ee-8109-43e8-9634-3b2f12e86e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dd09ce-9aba-48cf-8bb0-2403744cfd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Volume 6f9b7321-fd67-49bc-aa07-46e3dc28c2a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4', 'volume_size': 1} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925497117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9b7321-fd67-49bc-aa07-46e3dc28c2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:41Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Creating volume 6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:41 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-8570834a-053d-4781-bcf5-eda009cd5c0c tempest-ProjectReaderTests-1609370007 None] Lock "cinder-869c76c8-00e2-4ec0-8079-d0dd0f7eac61-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:41 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 1073741824 Jul 08 19:53:41 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:42 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 1073741824" returned: 0 in 1.055s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:42 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 Jul 08 19:53:42 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (20626ce6-2bc5-443b-8f8f-b02cba9807fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc08bac-cba1-4af4-bac5-e0356c7f4c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc08bac-cba1-4af4-bac5-e0356c7f4c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933881062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fae9072-b001-433c-92f0-467903bb0aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:42Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c9f320-6451-4ccf-89c2-124eae9408b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c9f320-6451-4ccf-89c2-124eae9408b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f740262-6499-4d79-a35f-b1702d0dc503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f740262-6499-4d79-a35f-b1702d0dc503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fae9072-b001-433c-92f0-467903bb0aab', 'volume_name': 'volume-8fae9072-b001-433c-92f0-467903bb0aab', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c83c38c-1e1d-4db8-b81b-c777bc34eb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c83c38c-1e1d-4db8-b81b-c777bc34eb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc699f7f-7b0d-4fd6-bb37-6745d4404c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:42 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Volume 8fae9072-b001-433c-92f0-467903bb0aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fae9072-b001-433c-92f0-467903bb0aab', 'volume_size': 1} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:42 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" returned: 0 in 0.720s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933881062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fae9072-b001-433c-92f0-467903bb0aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:42Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Creating volume 8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:43 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dd09ce-9aba-48cf-8bb0-2403744cfd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cfa6c4-b2e8-4d42-9261-3a137cb51604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:43 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab 1073741824 Jul 08 19:53:43 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:43 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Volume volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 (6f9b7321-fd67-49bc-aa07-46e3dc28c2a4): created successfully Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cfa6c4-b2e8-4d42-9261-3a137cb51604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:43 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (78ea346c-a54d-4dc9-9cc0-a0e0ca14833c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:43 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c0946bb5-5db8-411b-9be2-b7cd103b9e77 tempest-ProjectReaderTests-1609370007 None] Created volume successfully. Jul 08 19:53:43 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab 1073741824" returned: 0 in 0.981s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:44 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab Jul 08 19:53:44 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:44 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab" returned: 0 in 0.748s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Creating offline snapshot a1d48f04-b7d0-44d1-b461-59202354e097 of volume 6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc699f7f-7b0d-4fd6-bb37-6745d4404c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fae9072-b001-433c-92f0-467903bb0aab', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8595be12-54ce-40f1-a8d4-7134ec7114a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e869f61d-99e2-46aa-b342-0a65457292ec]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:44 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Volume volume-8fae9072-b001-433c-92f0-467903bb0aab (8fae9072-b001-433c-92f0-467903bb0aab): created successfully Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8595be12-54ce-40f1-a8d4-7134ec7114a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:44 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (20626ce6-2bc5-443b-8f8f-b02cba9807fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:44 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-339e24ed-d167-4b51-a043-65bf4add74b4 tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:53:44 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 Jul 08 19:53:44 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:45 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" returned: 0 in 0.869s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:45 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 1G Jul 08 19:53:45 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:46 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 1G" returned: 0 in 0.916s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:46 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 Jul 08 19:53:46 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:47 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097" returned: 0 in 0.705s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:47 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 is being set with open permissions: ugo+rw Jul 08 19:53:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:47 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 Jul 08 19:53:47 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:48 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097" returned: 0 in 0.671s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:48 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info Jul 08 19:53:48 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:48 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info" returned: 0 in 0.728s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:48 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info is being set with open permissions: ugo+rw Jul 08 19:53:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:48 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info Jul 08 19:53:48 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:49 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.info" returned: 0 in 0.693s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.690s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.398s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:49 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Creating offline snapshot 58d284db-7d7a-4e23-bca6-451a3651a851 of volume 8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:53:49 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dfc9bc4d-0760-431e-80be-eccb7b489de7 tempest-ProjectReaderTests-1609370007 None] Create snapshot completed successfully Jul 08 19:53:49 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ba610-eb4b-41f7-a46c-5e03fb5ea35a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:49 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab Jul 08 19:53:49 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:50 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab" returned: 0 in 0.784s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:50 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 1G Jul 08 19:53:50 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-a1d48f04-b7d0-44d1-b461-59202354e097-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-a1d48f04-b7d0-44d1-b461-59202354e097-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-a1d48f04-b7d0-44d1-b461-59202354e097" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-a1d48f04-b7d0-44d1-b461-59202354e097" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Deleting offline snapshot a1d48f04-b7d0-44d1-b461-59202354e097 of volume 6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] snapshot_file for this snap is: volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e07d3-f8b6-4d11-9c1f-f856c67e858b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:50 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 Jul 08 19:53:50 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:51 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 1G" returned: 0 in 0.954s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fae9072-b001-433c-92f0-467903bb0aab -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:51 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fae9072-b001-433c-92f0-467903bb0aab -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 Jul 08 19:53:51 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:51 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097" returned: 0 in 0.845s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:53:51 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408a432-34b3-434e-869c-4b945e02b393]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:51 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 Jul 08 19:53:51 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:52 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fae9072-b001-433c-92f0-467903bb0aab -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851" returned: 0 in 0.902s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:52 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 is being set with open permissions: ugo+rw Jul 08 19:53:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:52 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 Jul 08 19:53:52 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:52 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:52 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 Jul 08 19:53:52 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:52 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851" returned: 0 in 0.743s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:52 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info Jul 08 19:53:52 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:53 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097" returned: 0 in 0.881s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:53 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097 Jul 08 19:53:53 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:53 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info" returned: 0 in 0.685s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:53 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info is being set with open permissions: ugo+rw Jul 08 19:53:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:53 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info Jul 08 19:53:53 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:54 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4.a1d48f04-b7d0-44d1-b461-59202354e097" returned: 0 in 0.744s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-a1d48f04-b7d0-44d1-b461-59202354e097" released by "_delete_snapshot" :: held 3.474s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" released by "delete_snapshot" :: held 3.501s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Created reservations ['4ae12865-4663-4933-ab73-214a52486f70', '2eba5bb8-d791-4ac2-82ea-6c0aabf9ef45', '7e1fe940-da99-4168-a8e5-48fc01680996', '3947b777-ac34-4aca-83fc-6c6ad3f5d221'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:54 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.info" returned: 0 in 0.712s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.899s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Delete snapshot completed successfully. Jul 08 19:53:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-af2e77d5-61ea-4c54-9953-111979773882 tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-094d8bbb-4a32-4c95-8696-59b693cb9983 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-a1d48f04-b7d0-44d1-b461-59202354e097-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:54 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Lock "cinder-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d95544-a743-4129-a126-41459565b281]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:55 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 Jul 08 19:53:55 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-58d284db-7d7a-4e23-bca6-451a3651a851-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-58d284db-7d7a-4e23-bca6-451a3651a851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-8fae9072-b001-433c-92f0-467903bb0aab" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8fae9072-b001-433c-92f0-467903bb0aab" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-58d284db-7d7a-4e23-bca6-451a3651a851" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-58d284db-7d7a-4e23-bca6-451a3651a851" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot 58d284db-7d7a-4e23-bca6-451a3651a851 of volume 8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ceb9d-8367-4664-8c90-aa731ec19daa]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:55 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 Jul 08 19:53:55 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:55 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:55 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4 Jul 08 19:53:55 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:56 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851" returned: 0 in 0.847s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fae9072-b001-433c-92f0-467903bb0aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94d812d-6772-45c0-b316-6f660a640ae7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:56 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab Jul 08 19:53:56 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:56 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" returned: 0 in 0.724s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4" released by "delete_volume" :: held 1.596s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:DELETE=12,cinder:SELECT=112,cinder:UPDATE=126,cinder:INSERT=38 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:INSERT=46,cinder:UPDATE=164,cinder:SELECT=117,cinder:DELETE=12 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Created reservations ['a8aa2d82-8b6d-4590-bffc-f27617f91fba', 'b508d7f7-18a4-44a1-8170-1b6b8b6fe13c', '43e0afa8-8179-4eaf-b6ba-db9d76420114', 'e19b755b-9cab-40d8-b219-ee0d200dec34'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:56 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:53:56 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:57 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab" returned: 0 in 0.976s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:57 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 Jul 08 19:53:57 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:57 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.717s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:53:57 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Deleted volume successfully. Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-498f48e1-10f1-4412-9924-7757ba7467da tempest-ProjectReaderTests-1609370007 None] Lock "cinder-6f9b7321-fd67-49bc-aa07-46e3dc28c2a4-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (82c76b58-24dd-43a9-9147-65073b388736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126067a5-35fd-47e7-9889-37eae00fec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126067a5-35fd-47e7-9889-37eae00fec13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29875967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:58Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02f87a9-281f-4e7a-9f75-5d39af12147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02f87a9-281f-4e7a-9f75-5d39af12147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c49450e-2336-4e68-be75-007038bcd1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c49450e-2336-4e68-be75-007038bcd1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e', 'volume_name': 'volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d52a16c-bb1b-49b6-a9d6-ed22c25ea5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d52a16c-bb1b-49b6-a9d6-ed22c25ea5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e94381b-65b4-41ae-8643-2c89c885d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:57 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Volume dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e', 'volume_size': 1} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29875967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f12631b64c46bea971e15c88a78032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:53:58Z,use_quota=True,user_id='1330a9ac5c3d477db947d25e779348c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Creating volume dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:53:57 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:53:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:57 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e 1073741824 Jul 08 19:53:57 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:58 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851" returned: 0 in 0.883s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:58 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851 Jul 08 19:53:58 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:58 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e 1073741824" returned: 0 in 0.856s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:58 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e Jul 08 19:53:58 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:53:59 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab.58d284db-7d7a-4e23-bca6-451a3651a851" returned: 0 in 0.719s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-58d284db-7d7a-4e23-bca6-451a3651a851" released by "_delete_snapshot" :: held 3.580s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8fae9072-b001-433c-92f0-467903bb0aab" released by "delete_snapshot" :: held 3.603s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Created reservations ['a14cde30-5559-4ac6-a35c-cf7275308beb', '62ac55cc-1ffc-4353-88f5-5638277563c1', '85f06604-535c-4142-90f5-20b17282192a', '9558a6af-20d9-446d-9513-111e823b90fa'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:53:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ecffc9aa-b349-4d22-bd0e-ad561dc8fde3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-58d284db-7d7a-4e23-bca6-451a3651a851-delete_snapshot" released by "delete_snapshot" :: held 3.749s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:53:59 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" returned: 0 in 0.697s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e94381b-65b4-41ae-8643-2c89c885d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8d0d15-668c-499b-af71-83fbf591dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:53:59 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Volume volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e (dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e): created successfully Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8d0d15-668c-499b-af71-83fbf591dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Flow 'volume_create_manager' (82c76b58-24dd-43a9-9147-65073b388736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:53:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f380da35-67ef-486b-bcde-55683e64ffa8 tempest-ProjectReaderTests-1609370007 None] Created volume successfully. Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-8fae9072-b001-433c-92f0-467903bb0aab-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Lock "cinder-8fae9072-b001-433c-92f0-467903bb0aab-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-8fae9072-b001-433c-92f0-467903bb0aab" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8fae9072-b001-433c-92f0-467903bb0aab" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd007d-8fcf-461c-9053-3950d6b55852]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:53:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:53:59 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab Jul 08 19:53:59 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Creating offline snapshot 4470931a-69ce-4c50-b847-b41cc3113214 of volume dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1767f702-581c-4038-a55b-acd73adc9ba6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:00 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e Jul 08 19:54:00 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:00 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab" returned: 0 in 0.758s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:00 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab Jul 08 19:54:00 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:00 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" returned: 0 in 0.871s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:00 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 1G Jul 08 19:54:00 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:01 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8fae9072-b001-433c-92f0-467903bb0aab" returned: 0 in 0.656s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8fae9072-b001-433c-92f0-467903bb0aab" released by "delete_volume" :: held 1.483s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Created reservations ['d9264795-8ac4-4b5f-a13a-0c601187f748', '3c1d8f56-a06d-44c5-8892-a0a56cf0054c', '81087cb3-42b4-4c68-9a65-d985ccc08706', '47ab14ef-0e9b-472c-bb05-d28a04ef6693'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:01 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:01 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:01 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 1G" returned: 0 in 0.811s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:01 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 Jul 08 19:54:01 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:02 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.628s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:02 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-24056957-fcf2-451a-b3a0-996794f4248a tempest-ProjectMemberTests-255153380 None] Lock "cinder-8fae9072-b001-433c-92f0-467903bb0aab-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (0741f7b2-1c82-4eb4-b7d9-594ee72153f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5a2c66-4391-41d8-9632-c6a29da614a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5a2c66-4391-41d8-9632-c6a29da614a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102992422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527c5785-a539-4560-8f80-8f8b271d6279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:02Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d119073-e6d2-4aab-a4d2-14fbeb31bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:02 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d119073-e6d2-4aab-a4d2-14fbeb31bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1ad126-330a-4c6b-b807-7759165f256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae1ad126-330a-4c6b-b807-7759165f256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527c5785-a539-4560-8f80-8f8b271d6279', 'volume_name': 'volume-527c5785-a539-4560-8f80-8f8b271d6279', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050df1bb-d089-4fdd-9c63-358e15dbe01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050df1bb-d089-4fdd-9c63-358e15dbe01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25ba881-2693-4223-8df8-212fc393bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:02 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Volume 527c5785-a539-4560-8f80-8f8b271d6279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527c5785-a539-4560-8f80-8f8b271d6279', 'volume_size': 1} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214" returned: 0 in 0.732s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:02 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 is being set with open permissions: ugo+rw Jul 08 19:54:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:02 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 Jul 08 19:54:02 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:03 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214" returned: 0 in 0.615s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:03 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info Jul 08 19:54:03 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:03 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info" returned: 0 in 0.620s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:03 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info is being set with open permissions: ugo+rw Jul 08 19:54:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:03 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info Jul 08 19:54:03 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:04 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.info" returned: 0 in 0.608s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.340s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102992422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527c5785-a539-4560-8f80-8f8b271d6279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:02Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Creating volume 527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:04 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:04 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 1073741824 Jul 08 19:54:04 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-edfde3a2-9eae-4ac6-be6a-df276644fa6d tempest-ProjectReaderTests-1609370007 None] Create snapshot completed successfully Jul 08 19:54:05 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 1073741824" returned: 0 in 0.772s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:05 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 Jul 08 19:54:05 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-4470931a-69ce-4c50-b847-b41cc3113214-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-4470931a-69ce-4c50-b847-b41cc3113214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-4470931a-69ce-4c50-b847-b41cc3113214" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-4470931a-69ce-4c50-b847-b41cc3113214" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Deleting offline snapshot 4470931a-69ce-4c50-b847-b41cc3113214 of volume dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] snapshot_file for this snap is: volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f65b5d-5103-4848-bbdf-5c012141efb6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:05 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 Jul 08 19:54:05 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:05 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279" returned: 0 in 0.636s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25ba881-2693-4223-8df8-212fc393bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527c5785-a539-4560-8f80-8f8b271d6279', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6780723a-ab10-4d12-b0dd-ae8c552b4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:05 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Volume volume-527c5785-a539-4560-8f80-8f8b271d6279 (527c5785-a539-4560-8f80-8f8b271d6279): created successfully Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6780723a-ab10-4d12-b0dd-ae8c552b4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:05 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (0741f7b2-1c82-4eb4-b7d9-594ee72153f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dedc35a8-2868-4860-aa7c-3e31c124cdce tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:54:06 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214" returned: 0 in 0.771s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[478fdebd-2ae7-46b2-8345-57ddafb2a015]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:06 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e Jul 08 19:54:06 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Creating offline snapshot d4d18176-6a02-4cd9-9864-ebdf8e3ed222 of volume 527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1ecbec-f370-4253-8555-20bf945bff08]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:06 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 Jul 08 19:54:06 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:06 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" returned: 0 in 0.772s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:06 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 Jul 08 19:54:06 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:07 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279" returned: 0 in 0.759s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:07 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 1G Jul 08 19:54:07 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:07 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214" returned: 0 in 0.771s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:07 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214 Jul 08 19:54:07 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:08 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e.4470931a-69ce-4c50-b847-b41cc3113214" returned: 0 in 0.637s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:08 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-4470931a-69ce-4c50-b847-b41cc3113214" released by "_delete_snapshot" :: held 3.043s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 1G" returned: 0 in 0.804s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527c5785-a539-4560-8f80-8f8b271d6279 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" released by "delete_snapshot" :: held 3.079s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:08 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527c5785-a539-4560-8f80-8f8b271d6279 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 Jul 08 19:54:08 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Created reservations ['fea7a346-12fc-4bd1-8035-2a9648cee026', 'a880b9d2-1b9f-49ee-a7e9-476c40671ed1', '761eafa6-6e2f-4869-972b-f51d49740837', 'e264db61-aca6-4176-a261-60613831680c'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Delete snapshot completed successfully. Jul 08 19:54:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ef9044f1-ae48-42b6-ad90-8f31662ec7c5 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-4470931a-69ce-4c50-b847-b41cc3113214-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:09 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527c5785-a539-4560-8f80-8f8b271d6279 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222" returned: 0 in 0.678s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:09 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 is being set with open permissions: ugo+rw Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:09 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 Jul 08 19:54:09 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "cinder-quobyte-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b978364d-89b0-40ae-b1cc-3f48e4850da6]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:09 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e Jul 08 19:54:09 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:09 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222" returned: 0 in 0.685s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:09 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info Jul 08 19:54:09 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:10 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" returned: 0 in 0.737s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:10 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e Jul 08 19:54:10 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:10 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info" returned: 0 in 0.685s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:10 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info is being set with open permissions: ugo+rw Jul 08 19:54:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:10 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info Jul 08 19:54:10 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:11 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" returned: 0 in 0.668s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-quobyte-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e" released by "delete_volume" :: held 1.462s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Created reservations ['dd2881f4-f01f-4777-9924-0c694e01d737', '1e43e5f0-824d-4f8a-9825-afe44f75d1ec', 'ac9d1642-e25a-4ce5-8de3-f2fb3bcaf1aa', '97efb4ba-c713-4c61-8780-4ca3ea8a983d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:11 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.info" returned: 0 in 0.717s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:11 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:11 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-44177f9b-3a07-4558-917f-0bbdc61d1b6f tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:54:11 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.644s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Deleted volume successfully. Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-1e44a4e8-427c-4d48-b329-d1053a076db6 tempest-ProjectReaderTests-1609370007 None] Lock "cinder-dc367804-fe4f-4911-b1e7-0fdf1f0b2a7e-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-d4d18176-6a02-4cd9-9864-ebdf8e3ed222-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-d4d18176-6a02-4cd9-9864-ebdf8e3ed222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-527c5785-a539-4560-8f80-8f8b271d6279" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-527c5785-a539-4560-8f80-8f8b271d6279" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-d4d18176-6a02-4cd9-9864-ebdf8e3ed222" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-d4d18176-6a02-4cd9-9864-ebdf8e3ed222" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot d4d18176-6a02-4cd9-9864-ebdf8e3ed222 of volume 527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6eda3-aa06-4236-9f2b-6059f820d0c7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:12 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 Jul 08 19:54:12 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:12 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222" returned: 0 in 0.838s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-527c5785-a539-4560-8f80-8f8b271d6279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa6d9d3-d17e-4267-ae8e-ce4f74414394]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:13 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 Jul 08 19:54:13 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:13 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279" returned: 0 in 0.835s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:13 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 Jul 08 19:54:13 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:14 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222" returned: 0 in 0.742s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:14 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222 Jul 08 19:54:14 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:15 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279.d4d18176-6a02-4cd9-9864-ebdf8e3ed222" returned: 0 in 0.664s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-d4d18176-6a02-4cd9-9864-ebdf8e3ed222" released by "_delete_snapshot" :: held 3.193s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-527c5785-a539-4560-8f80-8f8b271d6279" released by "delete_snapshot" :: held 3.217s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Created reservations ['fc699961-39ed-43f0-9f80-38026abb5b70', 'd6734f58-5d58-4110-9876-43ebc8086eae', '5f2c675f-8ea3-4b0c-8a64-2c60c2d9d950', '4bd7e698-0841-4cf1-afa6-69e48e2abc77'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:15 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6f3426f0-0e0c-4b0b-b460-f1098f6c2fa3 tempest-ProjectMemberTests-255153380 None] Lock "cinder-d4d18176-6a02-4cd9-9864-ebdf8e3ed222-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Flow 'volume_create_manager' (32417289-39fb-422b-8a35-15f85efae1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b791af9c-584c-44a5-9951-17ceed9a7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b791af9c-584c-44a5-9951-17ceed9a7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742625638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22de506f-fb95-4d5c-a2ae-91bb80a01baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfd229a14644f9fa6e880cc8cefa24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:16Z,use_quota=True,user_id='4606e7216c344bdfb5ae8dfea8afbf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104a3f11-7315-4418-a92f-dee34fa43bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104a3f11-7315-4418-a92f-dee34fa43bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416547ee-a984-4bcc-9d49-29c347977cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416547ee-a984-4bcc-9d49-29c347977cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22de506f-fb95-4d5c-a2ae-91bb80a01baa', 'volume_name': 'volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1959d0-e0ff-45da-a78c-22d37196e117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1959d0-e0ff-45da-a78c-22d37196e117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd43c65-fb36-46a1-9b1e-586bfca4f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Volume 22de506f-fb95-4d5c-a2ae-91bb80a01baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa', 'volume_size': 1} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742625638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22de506f-fb95-4d5c-a2ae-91bb80a01baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfd229a14644f9fa6e880cc8cefa24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:16Z,use_quota=True,user_id='4606e7216c344bdfb5ae8dfea8afbf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Creating volume 22de506f-fb95-4d5c-a2ae-91bb80a01baa {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:15 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:15 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa 1073741824 Jul 08 19:54:15 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-527c5785-a539-4560-8f80-8f8b271d6279-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Lock "cinder-527c5785-a539-4560-8f80-8f8b271d6279-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-527c5785-a539-4560-8f80-8f8b271d6279" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-527c5785-a539-4560-8f80-8f8b271d6279" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[7173234e-d0d9-46f6-b283-78227b01d41b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:16 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 Jul 08 19:54:16 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:16 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa 1073741824" returned: 0 in 0.831s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:16 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa Jul 08 19:54:16 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:17 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279" returned: 0 in 0.741s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:17 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279 Jul 08 19:54:17 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:17 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa" returned: 0 in 0.617s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd43c65-fb36-46a1-9b1e-586bfca4f60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da607554-dbdc-467e-b0ed-7ae47b2c42dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:17 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Volume volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa (22de506f-fb95-4d5c-a2ae-91bb80a01baa): created successfully Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da607554-dbdc-467e-b0ed-7ae47b2c42dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Flow 'volume_create_manager' (32417289-39fb-422b-8a35-15f85efae1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:17 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-67e1bf30-f7dd-4493-aa45-e2446466b49a tempest-ProjectReaderTests-2144493446 None] Created volume successfully. Jul 08 19:54:17 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-527c5785-a539-4560-8f80-8f8b271d6279" returned: 0 in 0.634s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-527c5785-a539-4560-8f80-8f8b271d6279" released by "delete_volume" :: held 1.433s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Created reservations ['e127720c-4672-4b0e-af25-c68b93e17228', 'fc378899-14f9-4455-8a81-02751a76ae35', '1e2a6dd4-1572-4077-a016-ae0be4a96257', 'd9bca360-75fa-4697-879f-21180fcc4513'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "cinder-22de506f-fb95-4d5c-a2ae-91bb80a01baa-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-22de506f-fb95-4d5c-a2ae-91bb80a01baa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "cinder-quobyte-22de506f-fb95-4d5c-a2ae-91bb80a01baa" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-quobyte-22de506f-fb95-4d5c-a2ae-91bb80a01baa" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:17 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:17 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5fd92-afd3-4b2d-ab3a-bfc39b247034]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:18 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa Jul 08 19:54:18 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:18 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.637s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:18 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-9ebe2a29-8a29-4a1e-8dd2-06df61c1754b tempest-ProjectMemberTests-255153380 None] Lock "cinder-527c5785-a539-4560-8f80-8f8b271d6279-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:18 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:18 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa Jul 08 19:54:18 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (11f1ce95-98f3-42e3-aecf-9b7b37fef883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd17afe-b819-46ea-9fe5-555aa372a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd17afe-b819-46ea-9fe5-555aa372a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143411791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1eaa16-d879-44c1-9800-cced62271b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:19Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2053b1e3-c042-4b2c-ab7c-626c38f86606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2053b1e3-c042-4b2c-ab7c-626c38f86606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f789012b-b258-44bd-bb01-21513bf56fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f789012b-b258-44bd-bb01-21513bf56fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1eaa16-d879-44c1-9800-cced62271b7d', 'volume_name': 'volume-6a1eaa16-d879-44c1-9800-cced62271b7d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9c28d4-b431-4135-b637-83b68be03bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9c28d4-b431-4135-b637-83b68be03bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9e9690-fd7f-440e-a621-3d87fd110b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:18 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Volume 6a1eaa16-d879-44c1-9800-cced62271b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1eaa16-d879-44c1-9800-cced62271b7d', 'volume_size': 1} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143411791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1eaa16-d879-44c1-9800-cced62271b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:19Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Creating volume 6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:18 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:18 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d 1073741824 Jul 08 19:54:18 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:19 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-22de506f-fb95-4d5c-a2ae-91bb80a01baa" returned: 0 in 0.630s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-quobyte-22de506f-fb95-4d5c-a2ae-91bb80a01baa" released by "delete_volume" :: held 1.452s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Created reservations ['07a3bf2e-dcb6-4f7c-ba8e-849bb16bfcbd', 'ea787ead-1322-4611-9767-e7dc528ba505', '8ac4d827-4a99-49d4-aba3-55d2bbf9b9e5', '501e48fb-5533-4fe0-9c09-02cef15e2b08'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:19 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:19 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:19 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d 1073741824" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:19 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d Jul 08 19:54:19 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:20 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.673s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Deleted volume successfully. Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-0525ed48-bc17-4333-bb3e-a9dde33cb3d5 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-22de506f-fb95-4d5c-a2ae-91bb80a01baa-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:20 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d" returned: 0 in 0.655s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9e9690-fd7f-440e-a621-3d87fd110b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1eaa16-d879-44c1-9800-cced62271b7d', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad6043d-ab6f-46b8-8cf9-95cebebda6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Volume volume-6a1eaa16-d879-44c1-9800-cced62271b7d (6a1eaa16-d879-44c1-9800-cced62271b7d): created successfully Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad6043d-ab6f-46b8-8cf9-95cebebda6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (11f1ce95-98f3-42e3-aecf-9b7b37fef883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:20 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef6210da-a21a-4faf-9650-0030fc41690d tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Flow 'volume_create_manager' (2269a73c-553d-4c51-8790-d0c10895919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7422e6-5ba8-4803-be58-a21ba3d23715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7422e6-5ba8-4803-be58-a21ba3d23715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340647762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3798716b-eadb-48c9-9e9e-68f4f79745f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfd229a14644f9fa6e880cc8cefa24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:20Z,use_quota=True,user_id='4606e7216c344bdfb5ae8dfea8afbf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5117d2-956a-4d1e-abe0-e4eb98883ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5117d2-956a-4d1e-abe0-e4eb98883ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befc4907-eae0-4d12-9343-ca9f81997109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befc4907-eae0-4d12-9343-ca9f81997109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3798716b-eadb-48c9-9e9e-68f4f79745f8', 'volume_name': 'volume-3798716b-eadb-48c9-9e9e-68f4f79745f8', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e23868-38d0-41b2-abdf-b101b0ddcfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e23868-38d0-41b2-abdf-b101b0ddcfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a2c714-50ca-47ac-8fe6-d66d617fdb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Volume 3798716b-eadb-48c9-9e9e-68f4f79745f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3798716b-eadb-48c9-9e9e-68f4f79745f8', 'volume_size': 1} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340647762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3798716b-eadb-48c9-9e9e-68f4f79745f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dfd229a14644f9fa6e880cc8cefa24c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:20Z,use_quota=True,user_id='4606e7216c344bdfb5ae8dfea8afbf45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Creating volume 3798716b-eadb-48c9-9e9e-68f4f79745f8 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:20 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:20 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 1073741824 Jul 08 19:54:20 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:21 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 1073741824" returned: 0 in 0.792s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:21 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 Jul 08 19:54:21 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:22 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8" returned: 0 in 0.609s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.905s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Creating offline snapshot cd7ae548-2045-4d47-a430-4f04261b1d9d of volume 6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a2c714-50ca-47ac-8fe6-d66d617fdb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3798716b-eadb-48c9-9e9e-68f4f79745f8', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41704ea1-c565-4473-9b42-2a37e84eaf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e7e30-4b5f-4cdd-a85c-3f560cefa350]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:22 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Volume volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 (3798716b-eadb-48c9-9e9e-68f4f79745f8): created successfully Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41704ea1-c565-4473-9b42-2a37e84eaf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Flow 'volume_create_manager' (2269a73c-553d-4c51-8790-d0c10895919c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:22 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5215a637-2b88-4323-ac1a-3ae089b1ea56 tempest-ProjectReaderTests-2144493446 None] Created volume successfully. Jul 08 19:54:22 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d Jul 08 19:54:22 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "cinder-3798716b-eadb-48c9-9e9e-68f4f79745f8-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-3798716b-eadb-48c9-9e9e-68f4f79745f8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "cinder-quobyte-3798716b-eadb-48c9-9e9e-68f4f79745f8" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-quobyte-3798716b-eadb-48c9-9e9e-68f4f79745f8" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef12661-11a8-4d68-8ee8-4644ed0f5dd5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:22 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 Jul 08 19:54:22 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:22 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:22 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d 1G Jul 08 19:54:22 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:23 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8" returned: 0 in 0.765s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:23 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8 Jul 08 19:54:23 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:23 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d 1G" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1eaa16-d879-44c1-9800-cced62271b7d -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:23 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1eaa16-d879-44c1-9800-cced62271b7d -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d Jul 08 19:54:23 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:24 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-3798716b-eadb-48c9-9e9e-68f4f79745f8" returned: 0 in 0.635s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-quobyte-3798716b-eadb-48c9-9e9e-68f4f79745f8" released by "delete_volume" :: held 1.448s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Created reservations ['98c78c0c-ccd0-4d07-8b31-f1963793bf6a', '1355a50c-b942-4d4c-bb13-921f0ab2ac5d', 'd91b76cf-4c8d-41e7-9839-dc42401689af', 'ce45ed93-51f0-4ff7-8a45-a2eeeeb3dfcb'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:24 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:24 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:24 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1eaa16-d879-44c1-9800-cced62271b7d -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d" returned: 0 in 0.686s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:24 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d is being set with open permissions: ugo+rw Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:24 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d Jul 08 19:54:24 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:24 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.660s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Deleted volume successfully. Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f44c83e1-b9cb-458d-82be-6746e6be49b8 tempest-ProjectReaderTests-2144493446 None] Lock "cinder-3798716b-eadb-48c9-9e9e-68f4f79745f8-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:24 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:25 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info Jul 08 19:54:25 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:25 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info" returned: 0 in 0.640s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:25 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info is being set with open permissions: ugo+rw Jul 08 19:54:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:25 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info Jul 08 19:54:25 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:26 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.info" returned: 0 in 0.725s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.357s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-99a8a506-d6e6-4488-a08d-66799c7e7446 tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-cd7ae548-2045-4d47-a430-4f04261b1d9d-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Lock "cinder-cd7ae548-2045-4d47-a430-4f04261b1d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-6a1eaa16-d879-44c1-9800-cced62271b7d" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6a1eaa16-d879-44c1-9800-cced62271b7d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-cd7ae548-2045-4d47-a430-4f04261b1d9d" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-cd7ae548-2045-4d47-a430-4f04261b1d9d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot cd7ae548-2045-4d47-a430-4f04261b1d9d of volume 6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2441956-18bf-4fe4-9909-7e5d4750d6b1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:27 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d Jul 08 19:54:27 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:28 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a1eaa16-d879-44c1-9800-cced62271b7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:54:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9e0bad-7b66-4953-abc8-11af7348aade]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:28 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d Jul 08 19:54:28 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:29 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d" returned: 0 in 0.748s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:29 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d Jul 08 19:54:29 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:29 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d" returned: 0 in 0.778s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:29 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d Jul 08 19:54:29 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:30 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d.cd7ae548-2045-4d47-a430-4f04261b1d9d" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-cd7ae548-2045-4d47-a430-4f04261b1d9d" released by "_delete_snapshot" :: held 3.157s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6a1eaa16-d879-44c1-9800-cced62271b7d" released by "delete_snapshot" :: held 3.178s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:30 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Created reservations ['ef529960-d91f-45a4-b53c-035909ab1c24', 'ed4a8ef0-ef5a-475e-80e1-ee984e371a0e', 'c091afca-4555-45e3-bdb0-a37c8aecf61a', 'd2698140-0120-4b7e-bbc4-f3a4dd9c2d6f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:30 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:54:30 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-dbf2a628-e893-4693-9a29-3d1193944fba tempest-ProjectMemberTests-255153380 None] Lock "cinder-cd7ae548-2045-4d47-a430-4f04261b1d9d-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-6a1eaa16-d879-44c1-9800-cced62271b7d-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Lock "cinder-6a1eaa16-d879-44c1-9800-cced62271b7d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-6a1eaa16-d879-44c1-9800-cced62271b7d" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:31 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6a1eaa16-d879-44c1-9800-cced62271b7d" acquired by "delete_volume" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:31 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e58ac-eff3-40bd-bb99-07aa9b7ee626]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:31 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d Jul 08 19:54:31 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:32 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d" returned: 0 in 0.769s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:32 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d Jul 08 19:54:32 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:33 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-6a1eaa16-d879-44c1-9800-cced62271b7d" returned: 0 in 0.645s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6a1eaa16-d879-44c1-9800-cced62271b7d" released by "delete_volume" :: held 1.474s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Created reservations ['aad2b648-b2db-42fc-8cd7-90c52e66853d', '58b49153-5337-4f18-a210-607cb4c316fb', '51627b88-fc53-4f3c-8928-4195d0f35081', '4a198ede-4137-4a7f-a665-a53264d866fc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:33 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:33 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:34 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.693s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:34 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a9c92a41-b04f-4011-a797-77aeb392a2f8 tempest-ProjectMemberTests-255153380 None] Lock "cinder-6a1eaa16-d879-44c1-9800-cced62271b7d-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (0052ba40-d362-4967-8340-293bcbc9f4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728d50b6-a956-4725-be06-b0810eeff697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728d50b6-a956-4725-be06-b0810eeff697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191801168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc93841-74a8-47bf-98df-0902a8a54fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:34Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923701c5-9d93-4a4b-aade-4a3add6a646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923701c5-9d93-4a4b-aade-4a3add6a646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f44df8-93ca-4b11-bbeb-1ff742c9d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f44df8-93ca-4b11-bbeb-1ff742c9d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc93841-74a8-47bf-98df-0902a8a54fcb', 'volume_name': 'volume-1cc93841-74a8-47bf-98df-0902a8a54fcb', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd368bbc-c7e1-422a-b019-e1e0223186d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd368bbc-c7e1-422a-b019-e1e0223186d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948e527d-cf53-482b-990d-6b566ce0598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:34 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Volume 1cc93841-74a8-47bf-98df-0902a8a54fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc93841-74a8-47bf-98df-0902a8a54fcb', 'volume_size': 1} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191801168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc93841-74a8-47bf-98df-0902a8a54fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:34Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Creating volume 1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:34 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:34 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb 1073741824 Jul 08 19:54:34 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:34 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:34 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:35 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.652s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:54:35 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb 1073741824" returned: 0 in 0.918s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:35 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb Jul 08 19:54:35 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:36 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb" returned: 0 in 0.685s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948e527d-cf53-482b-990d-6b566ce0598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc93841-74a8-47bf-98df-0902a8a54fcb', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06c4034-f872-458f-ba32-ab5d12c6d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:36 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Volume volume-1cc93841-74a8-47bf-98df-0902a8a54fcb (1cc93841-74a8-47bf-98df-0902a8a54fcb): created successfully Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06c4034-f872-458f-ba32-ab5d12c6d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (0052ba40-d362-4967-8340-293bcbc9f4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4ab45a1b-7419-4e64-9da0-f967dd4c8da9 tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Creating offline snapshot 10657d35-f390-4239-876a-08c619f92e97 of volume 1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d57834-decc-4ce7-9fa1-b67961095ea3]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:36 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb Jul 08 19:54:36 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:37 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb" returned: 0 in 0.797s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:37 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 1G Jul 08 19:54:37 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:38 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 1G" returned: 0 in 0.807s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc93841-74a8-47bf-98df-0902a8a54fcb -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:38 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc93841-74a8-47bf-98df-0902a8a54fcb -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 Jul 08 19:54:38 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:39 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc93841-74a8-47bf-98df-0902a8a54fcb -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97" returned: 0 in 0.713s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:39 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 is being set with open permissions: ugo+rw Jul 08 19:54:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:39 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 Jul 08 19:54:39 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:39 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97" returned: 0 in 0.729s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:39 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info Jul 08 19:54:39 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:40 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info" returned: 0 in 0.707s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:40 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info is being set with open permissions: ugo+rw Jul 08 19:54:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:40 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info Jul 08 19:54:40 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:41 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.info" returned: 0 in 0.673s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.515s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d18f9321-8e02-4e96-a658-0b356990c42f tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:54:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-10657d35-f390-4239-876a-08c619f92e97-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Lock "cinder-10657d35-f390-4239-876a-08c619f92e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:41 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-1cc93841-74a8-47bf-98df-0902a8a54fcb" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-1cc93841-74a8-47bf-98df-0902a8a54fcb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-10657d35-f390-4239-876a-08c619f92e97" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-10657d35-f390-4239-876a-08c619f92e97" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot 10657d35-f390-4239-876a-08c619f92e97 of volume 1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfe3065-06fa-41a1-8f8c-7fde445fb3c0]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:42 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 Jul 08 19:54:42 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:42 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97" returned: 0 in 0.777s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc93841-74a8-47bf-98df-0902a8a54fcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7c033-19c1-4cba-8ca9-8816f05225e8]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:42 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb Jul 08 19:54:42 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:43 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb" returned: 0 in 0.817s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:43 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 Jul 08 19:54:43 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:44 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97" returned: 0 in 0.814s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:44 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97 Jul 08 19:54:44 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Flow 'volume_create_manager' (30208997-ef99-46cf-92df-6b33c39a2268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f32138d-c01a-46a6-8593-6c7229c0abcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f32138d-c01a-46a6-8593-6c7229c0abcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162309025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc76ea6-fa50-4e64-a938-9deff8c011ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd670c4bd3949f3acbf1f525c49face',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:45Z,use_quota=True,user_id='c7db5d50ff2640378cda8ae0369df717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d671931c-d572-43f7-8f4a-6949449d6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d671931c-d572-43f7-8f4a-6949449d6faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc8c17a-3297-406b-8255-c68848e7a180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc8c17a-3297-406b-8255-c68848e7a180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc76ea6-fa50-4e64-a938-9deff8c011ff', 'volume_name': 'volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50807b-8fcd-4901-9833-54c2c3d1537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d50807b-8fcd-4901-9833-54c2c3d1537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea21df8-4edc-4802-bc37-d33ea63ba154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:45 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Volume bdc76ea6-fa50-4e64-a938-9deff8c011ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff', 'volume_size': 1} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162309025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc76ea6-fa50-4e64-a938-9deff8c011ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd670c4bd3949f3acbf1f525c49face',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:45Z,use_quota=True,user_id='c7db5d50ff2640378cda8ae0369df717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Creating volume bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:45 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:45 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff 1073741824 Jul 08 19:54:45 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:45 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb.10657d35-f390-4239-876a-08c619f92e97" returned: 0 in 0.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-10657d35-f390-4239-876a-08c619f92e97" released by "_delete_snapshot" :: held 3.153s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-1cc93841-74a8-47bf-98df-0902a8a54fcb" released by "delete_snapshot" :: held 3.175s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Created reservations ['4133c7ef-ced3-47ff-9917-16bac8e5b09d', '85f14876-5540-4390-a829-a70638ded694', '4ea1494f-8043-4020-8a63-ebb96ec2dfd6', '947565b8-57a4-4e8c-8e69-f3bd693f0e69'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:45 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a1203a77-57d4-4c8b-8640-348a7629b104 tempest-ProjectMemberTests-255153380 None] Lock "cinder-10657d35-f390-4239-876a-08c619f92e97-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:45 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff 1073741824" returned: 0 in 0.788s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:45 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:54:45 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-1cc93841-74a8-47bf-98df-0902a8a54fcb-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Lock "cinder-1cc93841-74a8-47bf-98df-0902a8a54fcb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-1cc93841-74a8-47bf-98df-0902a8a54fcb" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-1cc93841-74a8-47bf-98df-0902a8a54fcb" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6805c58-4946-4c06-a597-f9d0580b8f58]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:46 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb Jul 08 19:54:46 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:46 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea21df8-4edc-4802-bc37-d33ea63ba154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601724c8-420c-43ce-bc92-9d24dc3aedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:46 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Volume volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff (bdc76ea6-fa50-4e64-a938-9deff8c011ff): created successfully Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601724c8-420c-43ce-bc92-9d24dc3aedd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:46 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Flow 'volume_create_manager' (30208997-ef99-46cf-92df-6b33c39a2268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:46 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6b8641ae-3229-423b-9d0b-2b3ca30c6220 tempest-SnapshotDependencyTests-1226790140 None] Created volume successfully. Jul 08 19:54:47 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb" returned: 0 in 0.777s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:47 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb Jul 08 19:54:47 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Creating offline snapshot cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 of volume bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a673d62-9b6a-4c12-8d6e-31d356dddb3f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:47 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:54:47 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:47 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-1cc93841-74a8-47bf-98df-0902a8a54fcb" returned: 0 in 0.659s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-1cc93841-74a8-47bf-98df-0902a8a54fcb" released by "delete_volume" :: held 1.497s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Created reservations ['f03ac6eb-fdbd-4b93-ad69-929eeb05dbe7', 'df11ffa1-3c58-4d0b-9434-5070d84addcb', 'cb54b694-ba4c-46ee-9848-32b66bff19bf', '9fa282b4-5381-46e5-ab01-0010f7021501'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:47 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:54:47 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:48 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.765s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:48 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 1G Jul 08 19:54:48 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:48 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.652s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:48 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:54:48 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:54:48 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3c142673-14bf-43fe-98bd-51bf1e6d7926 tempest-ProjectMemberTests-255153380 None] Lock "cinder-1cc93841-74a8-47bf-98df-0902a8a54fcb-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:49 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (066fd838-0f09-4369-a6d6-962f957a1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ed889b-4778-4c29-b07d-7d4f3358ecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 1G" returned: 0 in 0.910s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ed889b-4778-4c29-b07d-7d4f3358ecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440479342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20030480-36ef-4ee6-aa15-889ccbe77281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:49Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:49 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 Jul 08 19:54:49 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f9ef5b-f287-47bd-a92b-059ad3e88f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f9ef5b-f287-47bd-a92b-059ad3e88f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57623e30-b2e4-4e70-b68f-1c1823d3db0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57623e30-b2e4-4e70-b68f-1c1823d3db0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20030480-36ef-4ee6-aa15-889ccbe77281', 'volume_name': 'volume-20030480-36ef-4ee6-aa15-889ccbe77281', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f00476d-4d16-4a18-b878-b999e0f24176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f00476d-4d16-4a18-b878-b999e0f24176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74677c8-26b7-4b3b-a56c-8036ccdf36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:49 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Volume 20030480-36ef-4ee6-aa15-889ccbe77281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20030480-36ef-4ee6-aa15-889ccbe77281', 'volume_size': 1} Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:49 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" returned: 0 in 0.670s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:49 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 is being set with open permissions: ugo+rw Jul 08 19:54:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:49 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 Jul 08 19:54:49 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:50 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" returned: 0 in 0.608s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:50 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info Jul 08 19:54:50 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:51 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info" returned: 0 in 0.650s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:51 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info is being set with open permissions: ugo+rw Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:51 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info Jul 08 19:54:51 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:51 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.info" returned: 0 in 0.672s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440479342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20030480-36ef-4ee6-aa15-889ccbe77281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:49Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Creating volume 20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:51 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:54:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:51 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 1073741824 Jul 08 19:54:51 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:51 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ef4e476c-43a9-4719-80c1-8dc0c1306d0c tempest-SnapshotDependencyTests-1226790140 None] Create snapshot completed successfully Jul 08 19:54:52 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 1073741824" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:52 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 Jul 08 19:54:52 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Flow 'volume_create_manager' (6b3e64ad-d333-4b4f-a114-54ef5e58c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f18773c-8a60-40cd-8d94-a18c17a88be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:53 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281" returned: 0 in 0.643s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f18773c-8a60-40cd-8d94-a18c17a88be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95877dde-0f79-4d98-bc2a-bd01f05f7851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd670c4bd3949f3acbf1f525c49face',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfe937ed-b9a5-4f3c-81ac-11b021ecbf78,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:54:53Z,use_quota=True,user_id='c7db5d50ff2640378cda8ae0369df717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff9b197-d0a2-4cf3-ad59-f3b0823d6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff9b197-d0a2-4cf3-ad59-f3b0823d6797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d9a860-92d5-4b87-ac09-f12f23d45312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d9a860-92d5-4b87-ac09-f12f23d45312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95877dde-0f79-4d98-bc2a-bd01f05f7851', 'volume_name': 'volume-95877dde-0f79-4d98-bc2a-bd01f05f7851', 'volume_size': 1, 'snapshot_id': 'cfe937ed-b9a5-4f3c-81ac-11b021ecbf78'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95f3174-3360-4fe9-b1c5-96a68f2564b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95f3174-3360-4fe9-b1c5-96a68f2564b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccdaadc-ddf8-4a48-bf2c-22503e5882ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Volume 95877dde-0f79-4d98-bc2a-bd01f05f7851: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95877dde-0f79-4d98-bc2a-bd01f05f7851', 'volume_size': 1, 'snapshot_id': 'cfe937ed-b9a5-4f3c-81ac-11b021ecbf78'} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74677c8-26b7-4b3b-a56c-8036ccdf36a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20030480-36ef-4ee6-aa15-889ccbe77281', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d512c34-dda8-472e-b4b1-6a434cef2b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-quobyte-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78-95877dde-0f79-4d98-bc2a-bd01f05f7851" by "_create_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:53 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Volume volume-20030480-36ef-4ee6-aa15-889ccbe77281 (20030480-36ef-4ee6-aa15-889ccbe77281): created successfully Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d512c34-dda8-472e-b4b1-6a434cef2b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (066fd838-0f09-4369-a6d6-962f957a1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78-95877dde-0f79-4d98-bc2a-bd01f05f7851" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Creating volume 95877dde-0f79-4d98-bc2a-bd01f05f7851 from snapshot cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-quobyte-95877dde-0f79-4d98-bc2a-bd01f05f7851" by "_copy_volume_from_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:54:53 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3f01470d-160d-4637-a0aa-ea9f3d2b9ceb tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-95877dde-0f79-4d98-bc2a-bd01f05f7851" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] snapshot: cfe937ed-b9a5-4f3c-81ac-11b021ecbf78, volume: 95877dde-0f79-4d98-bc2a-bd01f05f7851, {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf32c9-4e43-4c49-b3e1-f74a8a4e3d6b]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:53 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 Jul 08 19:54:53 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:54 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" returned: 0 in 0.794s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Creating direct copy from snapshot {{(pid=87172) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[96411b58-7904-4f0d-bad6-23adccd99a31]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:54 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:54:54 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:54:54 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.751s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG cinder.utils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Path /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 not found in is_blk_device check {{(pid=87172) is_blk_device /opt/stack/cinder/cinder/utils.py:621}} Jul 08 19:54:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:54 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 Jul 08 19:54:54 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:54:59 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 08 19:54:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851" returned: 0 in 4.427s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:54:59 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad02c109-3f73-4744-9cf2-6167d9fe43b7]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:54:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:54:59 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:54:59 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:00 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.929s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG cinder.image.image_utils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Image conversion details: src /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 {{(pid=87172) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jul 08 19:55:00 devstack cinder-volume[87172]: INFO cinder.image.image_utils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Converted 1024.00 MB image at 231.25 MB/s Jul 08 19:55:00 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 is being set with open permissions: ugo+rw Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:00 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 Jul 08 19:55:00 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:00 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851" returned: 0 in 0.604s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-95877dde-0f79-4d98-bc2a-bd01f05f7851" released by "_copy_volume_from_snapshot" :: held 7.594s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78-95877dde-0f79-4d98-bc2a-bd01f05f7851" released by "_create_volume_from_snapshot" :: held 7.634s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.663s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.543s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:INSERT=34,cinder:UPDATE=117,cinder:SELECT=99,cinder:DELETE=10 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=93,cinder:INSERT=31,cinder:UPDATE=131,cinder:DELETE=11 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Creating offline snapshot b965f539-dca0-4c89-97cd-242ee4a9389b of volume 20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccdaadc-ddf8-4a48-bf2c-22503e5882ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95877dde-0f79-4d98-bc2a-bd01f05f7851', 'volume_size': 1, 'snapshot_id': 'cfe937ed-b9a5-4f3c-81ac-11b021ecbf78'}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb2c02b-2da4-402d-a586-443a900c07ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5193e2de-aff2-46a3-9bc4-800f0391f140]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:00 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Volume volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 (95877dde-0f79-4d98-bc2a-bd01f05f7851): created successfully Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb2c02b-2da4-402d-a586-443a900c07ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Flow 'volume_create_manager' (6b3e64ad-d333-4b4f-a114-54ef5e58c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:01 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e8f84236-2676-4422-9332-1b6639849e60 tempest-SnapshotDependencyTests-1226790140 None] Created volume successfully. Jul 08 19:55:01 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 Jul 08 19:55:01 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:01 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281" returned: 0 in 0.809s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:01 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b 1G Jul 08 19:55:01 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-quobyte-bdc76ea6-fa50-4e64-a938-9deff8c011ff" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-bdc76ea6-fa50-4e64-a938-9deff8c011ff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-quobyte-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Deleting offline snapshot cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 of volume bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] snapshot_file for this snap is: volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe659f-36d5-4b69-a856-345c674090fe]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:02 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 Jul 08 19:55:02 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:02 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b 1G" returned: 0 in 0.807s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20030480-36ef-4ee6-aa15-889ccbe77281 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:02 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20030480-36ef-4ee6-aa15-889ccbe77281 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b Jul 08 19:55:02 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:02 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" returned: 0 in 0.763s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:02 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:55:02 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b036280-9038-4f87-9234-3907eb462e49]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:02 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:55:02 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:03 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20030480-36ef-4ee6-aa15-889ccbe77281 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b" returned: 0 in 0.667s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:03 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b is being set with open permissions: ugo+rw Jul 08 19:55:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:03 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b Jul 08 19:55:03 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:03 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.764s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:03 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 Jul 08 19:55:03 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:03 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b" returned: 0 in 0.650s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:03 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info Jul 08 19:55:03 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:04 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" returned: 0 in 0.708s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:04 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78 Jul 08 19:55:04 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:04 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info" returned: 0 in 0.631s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:04 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info is being set with open permissions: ugo+rw Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:04 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info Jul 08 19:55:04 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:04 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff.cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" returned: 0 in 0.634s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78" released by "_delete_snapshot" :: held 2.981s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-bdc76ea6-fa50-4e64-a938-9deff8c011ff" released by "delete_snapshot" :: held 3.003s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Created reservations ['23402339-0046-40c5-b8b0-3a9c7be5390d', '50d6787c-47ab-4c41-8099-1b5fd682d3fe', '59258bdc-0767-4d75-a64c-af9eecf7436e', '782589d8-75c3-4256-93ca-1272d420174f'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:04 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Delete snapshot completed successfully. Jul 08 19:55:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-459dd1cd-8313-4993-9a8f-00f354b88369 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-cfe937ed-b9a5-4f3c-81ac-11b021ecbf78-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:05 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.info" returned: 0 in 0.660s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.331s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:05 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5c75ccd9-d335-45f9-8b33-a28f76ddc874 tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-b965f539-dca0-4c89-97cd-242ee4a9389b-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Lock "cinder-b965f539-dca0-4c89-97cd-242ee4a9389b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-20030480-36ef-4ee6-aa15-889ccbe77281" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-20030480-36ef-4ee6-aa15-889ccbe77281" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-b965f539-dca0-4c89-97cd-242ee4a9389b" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-b965f539-dca0-4c89-97cd-242ee4a9389b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot b965f539-dca0-4c89-97cd-242ee4a9389b of volume 20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b29339f-80e1-4d40-8eb9-e4a475e27c0e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-bdc76ea6-fa50-4e64-a938-9deff8c011ff-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-bdc76ea6-fa50-4e64-a938-9deff8c011ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:06 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b Jul 08 19:55:06 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-quobyte-bdc76ea6-fa50-4e64-a938-9deff8c011ff" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-bdc76ea6-fa50-4e64-a938-9deff8c011ff" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e022bc9-21b8-4d25-b13e-3322dbeb469e]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:06 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:55:06 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:06 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b" returned: 0 in 0.750s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20030480-36ef-4ee6-aa15-889ccbe77281(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[1547ca7b-31b8-46ed-82f6-88e47ffd9c6f]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:06 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 Jul 08 19:55:06 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:06 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.739s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:06 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff Jul 08 19:55:06 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:07 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281" returned: 0 in 0.749s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:07 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b Jul 08 19:55:07 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:07 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bdc76ea6-fa50-4e64-a938-9deff8c011ff" returned: 0 in 0.647s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-bdc76ea6-fa50-4e64-a938-9deff8c011ff" released by "delete_volume" :: held 1.445s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Created reservations ['c1683f74-7455-432d-bc1b-b600f6e86f29', '1f4c29e9-6bfd-44a0-ac06-ddf15e6a6fdd', '559847e9-bb60-4721-b86d-0e9aa2878072', '7a447ead-dbc5-4c5b-8d5f-a44f7babe463'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:07 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:07 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:07 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:08 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b" returned: 0 in 0.726s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:08 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b Jul 08 19:55:08 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-95877dde-0f79-4d98-bc2a-bd01f05f7851-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-95877dde-0f79-4d98-bc2a-bd01f05f7851-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "cinder-quobyte-95877dde-0f79-4d98-bc2a-bd01f05f7851" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:08 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.680s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-95877dde-0f79-4d98-bc2a-bd01f05f7851" acquired by "delete_volume" :: waited 0.030s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:08 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Deleted volume successfully. Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dc315b-1d94-4325-bb3d-fc57c8a9dce1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-6c193d6d-220c-48d2-b895-d8a192070800 tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-bdc76ea6-fa50-4e64-a938-9deff8c011ff-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:08 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 Jul 08 19:55:08 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:08 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281.b965f539-dca0-4c89-97cd-242ee4a9389b" returned: 0 in 0.704s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-b965f539-dca0-4c89-97cd-242ee4a9389b" released by "_delete_snapshot" :: held 3.023s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:08 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-20030480-36ef-4ee6-aa15-889ccbe77281" released by "delete_snapshot" :: held 3.044s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Created reservations ['136ef053-da9d-4ced-a336-1d14933aa5d1', '72af6916-77e4-4391-8c2e-f8eaa6d081d3', '7ae7867e-5887-472a-b165-804b19cae511', '3c8c2cee-61f6-4146-b083-0607da54c32d'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:09 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c05a7414-e049-4631-a339-9a01ed7eb80c tempest-ProjectMemberTests-255153380 None] Lock "cinder-b965f539-dca0-4c89-97cd-242ee4a9389b-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:09 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851" returned: 0 in 0.763s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:09 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851 Jul 08 19:55:09 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:09 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-95877dde-0f79-4d98-bc2a-bd01f05f7851" returned: 0 in 0.623s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-quobyte-95877dde-0f79-4d98-bc2a-bd01f05f7851" released by "delete_volume" :: held 1.429s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Created reservations ['3d687686-152c-4c41-b097-fab504423d85', '8cbeedf3-0876-4a7c-9a45-a442729f908c', '4e51fced-e759-41e2-b702-72585f1bf562', '0ec5d6f6-7e8f-49e4-b915-711f7423d7a7'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:09 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:09 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:09 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-20030480-36ef-4ee6-aa15-889ccbe77281-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Lock "cinder-20030480-36ef-4ee6-aa15-889ccbe77281-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-20030480-36ef-4ee6-aa15-889ccbe77281" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-20030480-36ef-4ee6-aa15-889ccbe77281" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23eb37a-98b4-4098-bd1f-1da284e0d389]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:10 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 Jul 08 19:55:10 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:10 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.706s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:10 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Deleted volume successfully. Jul 08 19:55:10 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-f451067f-2470-4657-846c-2f65e1b79a4a tempest-SnapshotDependencyTests-1226790140 None] Lock "cinder-95877dde-0f79-4d98-bc2a-bd01f05f7851-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:11 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281" returned: 0 in 0.810s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:11 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281 Jul 08 19:55:11 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:11 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-20030480-36ef-4ee6-aa15-889ccbe77281" returned: 0 in 0.668s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-20030480-36ef-4ee6-aa15-889ccbe77281" released by "delete_volume" :: held 1.543s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Created reservations ['ddba2a41-50aa-40d1-8be8-617602e15208', 'b9bede06-4cb1-4095-914a-bdaa54050477', '2104427f-4dde-4403-a00f-365f181add03', 'b607d00d-3377-4991-a3d1-93bd9004aaef'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:11 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:11 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:12 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.981s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:12 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:12 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:55:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-4223a606-b106-43ce-b409-4be8ddbfbccf tempest-ProjectMemberTests-255153380 None] Lock "cinder-20030480-36ef-4ee6-aa15-889ccbe77281-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (25d20b5b-ef78-496b-b242-94deaf1d9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eadb710-03f2-4ffe-8fed-8e9b13c8dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eadb710-03f2-4ffe-8fed-8e9b13c8dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102876132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbbd18d-e20c-4ae5-9c86-6fe130ef4249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:13Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d84d7d2-ceb9-4628-b5df-807be7829491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d84d7d2-ceb9-4628-b5df-807be7829491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151e4645-08bb-490e-9a1f-7865e5b257f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151e4645-08bb-490e-9a1f-7865e5b257f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbbd18d-e20c-4ae5-9c86-6fe130ef4249', 'volume_name': 'volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526cf070-2577-49e0-9396-3f5584bde97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526cf070-2577-49e0-9396-3f5584bde97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f727e8-da8d-4506-8df0-0848f116f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:13 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Volume bbbbd18d-e20c-4ae5-9c86-6fe130ef4249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249', 'volume_size': 1} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102876132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbbd18d-e20c-4ae5-9c86-6fe130ef4249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:13Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Creating volume bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:55:13 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:55:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:13 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 1073741824 Jul 08 19:55:13 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:14 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 1073741824" returned: 0 in 0.905s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:14 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 Jul 08 19:55:14 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:14 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" returned: 0 in 0.702s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f727e8-da8d-4506-8df0-0848f116f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5352be3-32fd-4e0a-9f6d-b9ee354333bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:14 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Volume volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 (bbbbd18d-e20c-4ae5-9c86-6fe130ef4249): created successfully Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5352be3-32fd-4e0a-9f6d-b9ee354333bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:14 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (25d20b5b-ef78-496b-b242-94deaf1d9a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:14 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3bd83dd9-6a7d-418c-83c8-bed9f1d1daa2 tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Creating offline snapshot 6eff6987-e336-4b4c-b6fa-df2374714cf5 of volume bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee13c45-9bb8-44b5-aa52-22f03b455826]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:15 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 Jul 08 19:55:15 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:15 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" returned: 0 in 0.792s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:15 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 1G Jul 08 19:55:15 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:16 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 1G" returned: 0 in 0.806s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:16 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 Jul 08 19:55:16 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:17 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5" returned: 0 in 0.684s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:17 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 is being set with open permissions: ugo+rw Jul 08 19:55:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:17 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 Jul 08 19:55:17 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:18 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5" returned: 0 in 0.724s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:18 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info Jul 08 19:55:18 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:18 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info" returned: 0 in 0.741s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:18 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info is being set with open permissions: ugo+rw Jul 08 19:55:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:18 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info Jul 08 19:55:18 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:19 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.info" returned: 0 in 0.733s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.573s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-42907257-63e3-43fc-9be7-ea675b130790 tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-6eff6987-e336-4b4c-b6fa-df2374714cf5-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-6eff6987-e336-4b4c-b6fa-df2374714cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-6eff6987-e336-4b4c-b6fa-df2374714cf5" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6eff6987-e336-4b4c-b6fa-df2374714cf5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot 6eff6987-e336-4b4c-b6fa-df2374714cf5 of volume bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc312e0a-848f-4e37-8091-c268f6555471]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:20 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 Jul 08 19:55:20 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:21 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5" returned: 0 in 0.764s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:55:21 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669062c-1feb-4cfc-bb18-f5f058f77aeb]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:21 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 Jul 08 19:55:21 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:22 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" returned: 0 in 0.733s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:22 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 Jul 08 19:55:22 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:22 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5" returned: 0 in 0.720s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:22 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5 Jul 08 19:55:22 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:23 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249.6eff6987-e336-4b4c-b6fa-df2374714cf5" returned: 0 in 0.608s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6eff6987-e336-4b4c-b6fa-df2374714cf5" released by "_delete_snapshot" :: held 2.924s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" released by "delete_snapshot" :: held 2.951s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Created reservations ['63e8d530-9790-4a2c-815a-00d12d81339d', 'b45c1d26-ea7b-4428-a953-a415d6828c5e', 'd699a3f1-ed65-40fa-bb5b-a2c443394b2e', '1424594f-1a4a-4d17-8b3b-cf589ed993a6'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:23 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7ee86cbe-399c-439d-b5f3-a7bfd2db9dc9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-6eff6987-e336-4b4c-b6fa-df2374714cf5-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Lock "cinder-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca7c569-50fc-434b-8d78-3db88c4bd0b2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:23 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 Jul 08 19:55:23 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:24 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" returned: 0 in 0.736s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:24 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249 Jul 08 19:55:24 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:25 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" returned: 0 in 0.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249" released by "delete_volume" :: held 1.431s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Created reservations ['57b858a2-8c00-4884-be18-271b1d7e6663', '2172c17d-1520-4d5d-bf55-49576c273405', 'b1c94505-a986-434d-b003-30829daa5cd5', '00083718-98fe-4430-962a-ed72baada3bc'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:25 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:25 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:25 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.635s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:25 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:55:25 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-15cbafbd-a09b-4e2e-a2c4-227bc4584e18 tempest-ProjectMemberTests-255153380 None] Lock "cinder-bbbbd18d-e20c-4ae5-9c86-6fe130ef4249-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (baba311e-c8d4-4d7b-83fd-cc1898f24fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abbba80-7b99-4883-b619-8af8ab15cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abbba80-7b99-4883-b619-8af8ab15cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286795363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533fbe24-3046-4abf-ad9f-cf20ecc2f0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:26Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c2d38c-17f0-4bec-a668-8e31c19c0b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c2d38c-17f0-4bec-a668-8e31c19c0b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ce09f3-0bdc-45b5-8507-8c298b699a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ce09f3-0bdc-45b5-8507-8c298b699a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533fbe24-3046-4abf-ad9f-cf20ecc2f0ae', 'volume_name': 'volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dae432-9f15-4f96-a537-83e18d2fe401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dae432-9f15-4f96-a537-83e18d2fe401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33125168-6693-40e3-a185-0d8ba9512e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Volume 533fbe24-3046-4abf-ad9f-cf20ecc2f0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae', 'volume_size': 1} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286795363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533fbe24-3046-4abf-ad9f-cf20ecc2f0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:26Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Creating volume 533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:55:26 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:55:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:26 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae 1073741824 Jul 08 19:55:26 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:27 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae 1073741824" returned: 0 in 0.781s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:27 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae Jul 08 19:55:27 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:27 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" returned: 0 in 0.605s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33125168-6693-40e3-a185-0d8ba9512e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ae1f43-6ad8-41bd-ad7b-c58dae88d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:27 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Volume volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae (533fbe24-3046-4abf-ad9f-cf20ecc2f0ae): created successfully Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32ae1f43-6ad8-41bd-ad7b-c58dae88d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:27 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (baba311e-c8d4-4d7b-83fd-cc1898f24fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:27 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e732588f-43d4-46b0-9e59-6033d4def069 tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:55:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Creating offline snapshot ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c of volume 533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:55:28 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[74621257-e00e-4c67-b00c-006aaf086878]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:28 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae Jul 08 19:55:28 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:29 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" returned: 0 in 0.731s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:29 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c 1G Jul 08 19:55:29 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:29 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c 1G" returned: 0 in 0.751s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:30 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c Jul 08 19:55:30 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:30 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" returned: 0 in 0.723s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:30 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c is being set with open permissions: ugo+rw Jul 08 19:55:30 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:30 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c Jul 08 19:55:30 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:31 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" returned: 0 in 0.636s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:31 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:31 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info Jul 08 19:55:31 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:32 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info" returned: 0 in 0.627s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:32 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info is being set with open permissions: ugo+rw Jul 08 19:55:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:32 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info Jul 08 19:55:32 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:32 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.info" returned: 0 in 0.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:32 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.192s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:32 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-2ab3aee2-2d53-47a3-a43b-e7a8e87928b0 tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Lock "cinder-ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c of volume 533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ad32e-7198-4839-b02e-92dc64efe0ff]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:33 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:33 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c Jul 08 19:55:33 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:34 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" returned: 0 in 0.765s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ccd193-b081-4b59-aa65-2b327c196778]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:34 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae Jul 08 19:55:34 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:34 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:34 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:35 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" returned: 0 in 0.766s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:35 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c Jul 08 19:55:35 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:35 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.637s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:55:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:55:36 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" returned: 0 in 0.722s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:36 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c Jul 08 19:55:36 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:36 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae.ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" returned: 0 in 0.616s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c" released by "_delete_snapshot" :: held 2.961s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" released by "delete_snapshot" :: held 2.990s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Created reservations ['076406f9-6a06-4f2b-ad8f-6744b59caf70', 'f423b2dc-3a58-4284-bc30-60e5e4556e97', '69890ba5-a51a-4960-9553-bf3cf29500bd', '8cb4dd95-7e8a-466f-a8d0-759896225fe5'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:36 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-7e158894-4443-4c1c-b5ae-21973c09c44f tempest-ProjectMemberTests-255153380 None] Lock "cinder-ea4ac2a4-fe8f-4571-a8ea-b7b3f6f2e57c-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Lock "cinder-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5979aec-2cc9-43d2-845b-f01c3dc5b06a]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:36 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:37 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae Jul 08 19:55:37 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:37 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" returned: 0 in 0.719s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:37 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:37 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae Jul 08 19:55:37 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:38 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" returned: 0 in 0.612s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae" released by "delete_volume" :: held 1.387s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Created reservations ['dfa94fe8-e8fe-46ff-bca6-a633ed895905', 'e814d5f6-f2aa-4fee-9dbb-e5839301ce44', '66b70b57-d6f4-4b16-a1ce-1fe7a3ec946b', '76bc9dd3-2392-4bf5-8854-edacc97e6a79'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:38 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:38 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:38 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:39 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.616s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:39 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-3ba16e7b-e387-48b2-b4c1-272a93610807 tempest-ProjectMemberTests-255153380 None] Lock "cinder-533fbe24-3046-4abf-ad9f-cf20ecc2f0ae-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (0edd78d2-4201-42cd-b8fe-d8a25988094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5378ac89-cb75-4800-a440-0bb37097fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5378ac89-cb75-4800-a440-0bb37097fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041212016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8fb48b-875a-4365-ac24-1188a5961511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:39Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08254857-272f-480f-981e-a2a2bd494177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08254857-272f-480f-981e-a2a2bd494177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de157280-e88a-432a-8213-cab6979623e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de157280-e88a-432a-8213-cab6979623e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8fb48b-875a-4365-ac24-1188a5961511', 'volume_name': 'volume-8b8fb48b-875a-4365-ac24-1188a5961511', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620d379b-5b0f-4be9-90bb-cf05de57152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620d379b-5b0f-4be9-90bb-cf05de57152c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede2c401-4a37-47f0-ab75-ea439659c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:39 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Volume 8b8fb48b-875a-4365-ac24-1188a5961511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8fb48b-875a-4365-ac24-1188a5961511', 'volume_size': 1} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2041212016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8fb48b-875a-4365-ac24-1188a5961511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:39Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Creating volume 8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:55:39 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:55:39 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:39 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 1073741824 Jul 08 19:55:39 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:40 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 1073741824" returned: 0 in 0.782s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:40 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:40 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 Jul 08 19:55:40 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:41 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511" returned: 0 in 0.623s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede2c401-4a37-47f0-ab75-ea439659c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8fb48b-875a-4365-ac24-1188a5961511', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661367bf-6d8d-48a8-be33-6f021825aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:41 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Volume volume-8b8fb48b-875a-4365-ac24-1188a5961511 (8b8fb48b-875a-4365-ac24-1188a5961511): created successfully Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661367bf-6d8d-48a8-be33-6f021825aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (0edd78d2-4201-42cd-b8fe-d8a25988094e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:41 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-5da067db-0021-476f-a166-6550979e48f7 tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Creating offline snapshot df8c40af-c671-454c-a647-202ed3904129 of volume 8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c96b3ad-d485-4e8f-a950-8078982611c1]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:41 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:41 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 Jul 08 19:55:41 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:42 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511" returned: 0 in 0.732s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:42 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:42 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 1G Jul 08 19:55:42 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:43 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 1G" returned: 0 in 0.783s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:43 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b8fb48b-875a-4365-ac24-1188a5961511 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:43 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b8fb48b-875a-4365-ac24-1188a5961511 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 Jul 08 19:55:43 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:44 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b8fb48b-875a-4365-ac24-1188a5961511 -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129" returned: 0 in 0.712s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:44 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 is being set with open permissions: ugo+rw Jul 08 19:55:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:44 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 Jul 08 19:55:44 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:44 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129" returned: 0 in 0.628s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:44 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:44 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info Jul 08 19:55:44 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:45 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info" returned: 0 in 0.620s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:45 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info is being set with open permissions: ugo+rw Jul 08 19:55:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:45 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info Jul 08 19:55:45 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:45 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.info" returned: 0 in 0.632s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:45 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.193s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:45 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-8eaf857c-d2b1-483b-b661-3d33b0650e0b tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:55:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-df8c40af-c671-454c-a647-202ed3904129-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Lock "cinder-df8c40af-c671-454c-a647-202ed3904129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:46 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-8b8fb48b-875a-4365-ac24-1188a5961511" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8b8fb48b-875a-4365-ac24-1188a5961511" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-df8c40af-c671-454c-a647-202ed3904129" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-df8c40af-c671-454c-a647-202ed3904129" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot df8c40af-c671-454c-a647-202ed3904129 of volume 8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c7cc4-53ad-4149-9920-2ebb54303307]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:47 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 Jul 08 19:55:47 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:47 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129" returned: 0 in 0.740s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b8fb48b-875a-4365-ac24-1188a5961511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e468f-36c2-4c80-91fe-2f79b18a58ec]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:47 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:47 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 Jul 08 19:55:47 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:48 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511" returned: 0 in 0.752s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:48 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:48 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 Jul 08 19:55:48 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:49 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129" returned: 0 in 0.722s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:49 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129 Jul 08 19:55:49 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:49 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:49 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511.df8c40af-c671-454c-a647-202ed3904129" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-df8c40af-c671-454c-a647-202ed3904129" released by "_delete_snapshot" :: held 2.952s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:49 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8b8fb48b-875a-4365-ac24-1188a5961511" released by "delete_snapshot" :: held 2.971s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Created reservations ['c8cc6225-6783-452e-bdf3-e15619202e47', 'b7bed886-0da4-44b8-a62f-bdf61cbf3a13', '7b23a9e0-bd02-497f-ab41-9073921e00d6', '9f279fd9-03a5-4268-a35d-e045d1fc94a7'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:50 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-a38adad9-12a4-46c1-af14-aaeb15c9d959 tempest-ProjectMemberTests-255153380 None] Lock "cinder-df8c40af-c671-454c-a647-202ed3904129-delete_snapshot" released by "delete_snapshot" :: held 3.103s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-8b8fb48b-875a-4365-ac24-1188a5961511-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Lock "cinder-8b8fb48b-875a-4365-ac24-1188a5961511-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-8b8fb48b-875a-4365-ac24-1188a5961511" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8b8fb48b-875a-4365-ac24-1188a5961511" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad2f5cc-3fab-4030-82e8-d82d285035d5]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:50 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:50 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 Jul 08 19:55:50 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:51 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511" returned: 0 in 0.795s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:51 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511 Jul 08 19:55:51 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:51 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-8b8fb48b-875a-4365-ac24-1188a5961511" returned: 0 in 0.658s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-8b8fb48b-875a-4365-ac24-1188a5961511" released by "delete_volume" :: held 1.513s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Created reservations ['cab6c62e-e767-4183-bba2-2f0627a58718', '1152db5b-2085-4b8c-9664-78cb8fd8bd21', '33622453-d155-4605-a661-d69d6e64084c', 'b8cacba5-f31a-4e3a-9be6-7c6a77c5e221'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:51 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:51 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:55:51 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:52 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.702s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:55:52 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-03fbcb28-87fb-48fe-8870-307eb2cb408a tempest-ProjectMemberTests-255153380 None] Lock "cinder-8b8fb48b-875a-4365-ac24-1188a5961511-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (dc03d8f7-4de7-4d30-8f3d-6638765ad207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3419f60e-3a6a-4a4d-89b8-190c70828479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3419f60e-3a6a-4a4d-89b8-190c70828479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639258506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f42616b-e64e-484a-96f7-ecac09b7daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:53Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc03590d-2856-4f9b-be5c-3df63ada2804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc03590d-2856-4f9b-be5c-3df63ada2804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896bab76-ce33-4944-ac68-11cddf9c829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896bab76-ce33-4944-ac68-11cddf9c829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f42616b-e64e-484a-96f7-ecac09b7daab', 'volume_name': 'volume-9f42616b-e64e-484a-96f7-ecac09b7daab', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ca5e2c-2d55-47c9-aad8-9219cf03bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ca5e2c-2d55-47c9-aad8-9219cf03bf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5e9964-ff66-42e1-b730-b75d3a5cd2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:52 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Volume 9f42616b-e64e-484a-96f7-ecac09b7daab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f42616b-e64e-484a-96f7-ecac09b7daab', 'volume_size': 1} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639258506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f42616b-e64e-484a-96f7-ecac09b7daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d94c05e7a5c4e31820ae03671b89b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:55:53Z,use_quota=True,user_id='620490b92e2e41e9ba736904da9e5cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Creating volume 9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:55:52 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:55:52 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:53 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab 1073741824 Jul 08 19:55:53 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:53 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab 1073741824" returned: 0 in 0.880s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:53 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:53 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab Jul 08 19:55:53 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:54 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab" returned: 0 in 0.730s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5e9964-ff66-42e1-b730-b75d3a5cd2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f42616b-e64e-484a-96f7-ecac09b7daab', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9680d7-5618-4031-ab40-3ed519b9507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:55:54 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Volume volume-9f42616b-e64e-484a-96f7-ecac09b7daab (9f42616b-e64e-484a-96f7-ecac09b7daab): created successfully Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9680d7-5618-4031-ab40-3ed519b9507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:55:54 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Flow 'volume_create_manager' (dc03d8f7-4de7-4d30-8f3d-6638765ad207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:55:54 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-725204e2-8b2b-4a3a-b8f2-dbf498c9bfdb tempest-ProjectMemberTests-255153380 None] Created volume successfully. Jul 08 19:55:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:55:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:55:55 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Creating offline snapshot 6fcd786f-a05b-4f76-83a8-e417b05e80d1 of volume 9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 19:55:55 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a79d5-0494-4556-a612-e1ba3c82873d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:55:55 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:55 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab Jul 08 19:55:55 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:56 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab" returned: 0 in 0.862s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 1G {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:56 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 1G Jul 08 19:55:56 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:56 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 1G" returned: 0 in 0.831s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:56 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f42616b-e64e-484a-96f7-ecac09b7daab -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:56 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f42616b-e64e-484a-96f7-ecac09b7daab -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 Jul 08 19:55:56 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:57 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f42616b-e64e-484a-96f7-ecac09b7daab -F qcow2 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1" returned: 0 in 0.727s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:57 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 is being set with open permissions: ugo+rw Jul 08 19:55:57 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:57 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 Jul 08 19:55:57 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:58 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1" returned: 0 in 0.642s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:58 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info Jul 08 19:55:58 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:58 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info" returned: 0 in 0.648s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:58 devstack cinder-volume[87172]: WARNING cinder.volume.drivers.remotefs [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info is being set with open permissions: ugo+rw Jul 08 19:55:58 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:55:58 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info Jul 08 19:55:58 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:55:59 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 08 19:55:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.info" returned: 0 in 0.622s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:55:59 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.420s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:55:59 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d8354ee3-a33c-4052-be6f-5f5b322faa23 tempest-ProjectMemberTests-255153380 None] Create snapshot completed successfully Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-6fcd786f-a05b-4f76-83a8-e417b05e80d1-delete_snapshot" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Lock "cinder-6fcd786f-a05b-4f76-83a8-e417b05e80d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-9f42616b-e64e-484a-96f7-ecac09b7daab" by "delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-9f42616b-e64e-484a-96f7-ecac09b7daab" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-6fcd786f-a05b-4f76-83a8-e417b05e80d1" by "_delete_snapshot" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6fcd786f-a05b-4f76-83a8-e417b05e80d1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Deleting offline snapshot 6fcd786f-a05b-4f76-83a8-e417b05e80d1 of volume 9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] snapshot_file for this snap is: volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 {{(pid=87172) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15f4866-7b4d-4bdd-b32d-527bc95e3814]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:00 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:00 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 Jul 08 19:56:00 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:01 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1" returned: 0 in 0.792s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:01 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f42616b-e64e-484a-96f7-ecac09b7daab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87172) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 19:56:01 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c993d88-d29d-47f7-b14c-78708db33540]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:01 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:01 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab Jul 08 19:56:01 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:02 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab" returned: 0 in 0.800s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:02 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 Jul 08 19:56:02 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:02 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1" returned: 0 in 0.714s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:02 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:02 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1 Jul 08 19:56:02 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:03 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab.6fcd786f-a05b-4f76-83a8-e417b05e80d1" returned: 0 in 0.700s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-6fcd786f-a05b-4f76-83a8-e417b05e80d1" released by "_delete_snapshot" :: held 3.097s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-9f42616b-e64e-484a-96f7-ecac09b7daab" released by "delete_snapshot" :: held 3.121s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=103,cinder:SELECT=72,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=89,cinder:DELETE=7,cinder:SELECT=76,cinder:INSERT=27 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Created reservations ['ab0def8c-4289-49e3-b4a1-82f9538c6a0a', 'f40d633f-5827-4d18-bf79-1a97fb4b8be0', 'c0e84701-ace9-435e-ab47-763ce4d09ede', '532403c7-0b53-453c-b2ab-9ecd02df809e'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:56:03 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Delete snapshot completed successfully. Jul 08 19:56:03 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-b0b6dfc2-ba9e-4570-be6c-84cc4edce2eb tempest-ProjectMemberTests-255153380 None] Lock "cinder-6fcd786f-a05b-4f76-83a8-e417b05e80d1-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-9f42616b-e64e-484a-96f7-ecac09b7daab-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-9f42616b-e64e-484a-96f7-ecac09b7daab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "cinder-quobyte-9f42616b-e64e-484a-96f7-ecac09b7daab" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:04 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-9f42616b-e64e-484a-96f7-ecac09b7daab" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:04 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7eda3a-a812-4d94-ae61-006f74ac85cc]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:04 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:04 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab Jul 08 19:56:04 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:05 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab" returned: 0 in 0.765s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:05 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:05 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab Jul 08 19:56:05 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:06 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-9f42616b-e64e-484a-96f7-ecac09b7daab" returned: 0 in 0.663s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-quobyte-9f42616b-e64e-484a-96f7-ecac09b7daab" released by "delete_volume" :: held 1.486s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Created reservations ['d8740b6f-13bc-4eb6-9959-8a722aa066c1', 'df5b362b-2560-4d9d-855c-da12e047fab2', '33aff035-48f6-43c6-99fe-739de1304679', '00fb1852-fb67-4d8d-b1b6-40f6befe0dad'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:06 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:56:06 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:06 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.626s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:56:06 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Deleted volume successfully. Jul 08 19:56:06 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-c403c3cf-2ecf-4be5-9f5b-4ce1c6223bd9 tempest-ProjectMemberTests-255153380 None] Lock "cinder-9f42616b-e64e-484a-96f7-ecac09b7daab-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (79e43755-9f35-4736-86a3-6131c4fede3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86294c99-9aba-4825-b49b-88b4f97a2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86294c99-9aba-4825-b49b-88b4f97a2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363669256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd53dfdd-c700-4dc0-8d1e-b22243c71d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:10Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c275e3e3-bc98-4c4f-a789-0387f692c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c275e3e3-bc98-4c4f-a789-0387f692c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8590b3-18d4-45b9-9485-a6039fcdb97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8590b3-18d4-45b9-9485-a6039fcdb97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd53dfdd-c700-4dc0-8d1e-b22243c71d88', 'volume_name': 'volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829d4f18-d46c-48c5-98d6-d2ed6bb2f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829d4f18-d46c-48c5-98d6-d2ed6bb2f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d527d41-1273-48f8-93d9-a8214d522044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:10 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Volume dd53dfdd-c700-4dc0-8d1e-b22243c71d88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88', 'volume_size': 1} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363669256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd53dfdd-c700-4dc0-8d1e-b22243c71d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:10Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Creating volume dd53dfdd-c700-4dc0-8d1e-b22243c71d88 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:56:10 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:56:10 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:10 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 1073741824 Jul 08 19:56:10 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:11 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 1073741824" returned: 0 in 0.801s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:11 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 Jul 08 19:56:11 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:11 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88" returned: 0 in 0.618s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d527d41-1273-48f8-93d9-a8214d522044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c226b033-8ea7-43c2-b790-0488b82c0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:11 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Volume volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 (dd53dfdd-c700-4dc0-8d1e-b22243c71d88): created successfully Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c226b033-8ea7-43c2-b790-0488b82c0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:11 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (79e43755-9f35-4736-86a3-6131c4fede3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:11 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-d7579367-c4b7-44b9-bac9-5597d93f5848 tempest-ProjectReaderTests-1095006254 None] Created volume successfully. Jul 08 19:56:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-dd53dfdd-c700-4dc0-8d1e-b22243c71d88-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Lock "cinder-dd53dfdd-c700-4dc0-8d1e-b22243c71d88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-quobyte-dd53dfdd-c700-4dc0-8d1e-b22243c71d88" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:12 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-dd53dfdd-c700-4dc0-8d1e-b22243c71d88" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:12 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bba150-67d8-4d24-8e54-f6e0b93c4220]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:12 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:12 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 Jul 08 19:56:12 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:13 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88" returned: 0 in 0.808s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:13 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:13 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88 Jul 08 19:56:13 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:14 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-dd53dfdd-c700-4dc0-8d1e-b22243c71d88" returned: 0 in 0.703s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-dd53dfdd-c700-4dc0-8d1e-b22243c71d88" released by "delete_volume" :: held 1.552s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Created reservations ['cbac62d7-d682-4ce9-ba4c-cfc8d551cae6', '908a84ee-9ee8-4ad3-830a-363243c22a69', 'a6d410e0-92f6-4b95-a299-fb051b0319fc', 'baf11228-742f-4619-a139-7e6ac81ae88b'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:14 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:56:14 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:14 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.647s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:56:14 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Deleted volume successfully. Jul 08 19:56:14 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-268c00e5-0ff1-4a34-a5c6-1913e54fe1ff tempest-ProjectReaderTests-1095006254 None] Lock "cinder-dd53dfdd-c700-4dc0-8d1e-b22243c71d88-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (d848c7b7-7b95-4d17-82f1-fe09ce74fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41a4a64-fb6d-4aa2-a27d-0e9b5d702b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41a4a64-fb6d-4aa2-a27d-0e9b5d702b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-619285797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5807e84e-700d-4ac1-8065-7fbe6783b0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:15Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ff903e-a9b4-46b9-a7de-bc328267fbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ff903e-a9b4-46b9-a7de-bc328267fbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f09922c-2ffe-4927-9bc7-f17bbb9991c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f09922c-2ffe-4927-9bc7-f17bbb9991c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5807e84e-700d-4ac1-8065-7fbe6783b0e5', 'volume_name': 'volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c39f22-0594-4d8f-9ce1-c48f80eb7a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c39f22-0594-4d8f-9ce1-c48f80eb7a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45636f6-3af8-43a2-bdfb-da513eec421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:15 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Volume 5807e84e-700d-4ac1-8065-7fbe6783b0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5', 'volume_size': 1} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-619285797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5807e84e-700d-4ac1-8065-7fbe6783b0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:15Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Creating volume 5807e84e-700d-4ac1-8065-7fbe6783b0e5 {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:56:15 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:56:15 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:15 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 1073741824 Jul 08 19:56:15 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:16 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 1073741824" returned: 0 in 0.824s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:16 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 Jul 08 19:56:16 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:16 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5" returned: 0 in 0.633s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45636f6-3af8-43a2-bdfb-da513eec421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09496da4-8d12-440b-9288-0279b59a9c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:16 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Volume volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 (5807e84e-700d-4ac1-8065-7fbe6783b0e5): created successfully Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09496da4-8d12-440b-9288-0279b59a9c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:16 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (d848c7b7-7b95-4d17-82f1-fe09ce74fb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:16 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0b9ca116-1f30-499f-9a19-19d05bf265d6 tempest-ProjectReaderTests-1095006254 None] Created volume successfully. Jul 08 19:56:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-5807e84e-700d-4ac1-8065-7fbe6783b0e5-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-5807e84e-700d-4ac1-8065-7fbe6783b0e5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-quobyte-5807e84e-700d-4ac1-8065-7fbe6783b0e5" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:17 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-5807e84e-700d-4ac1-8065-7fbe6783b0e5" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:17 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559aad8-60ca-42a3-a37c-781797bdcbda]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:17 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:17 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 Jul 08 19:56:17 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:18 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5" returned: 0 in 0.756s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:18 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5 Jul 08 19:56:18 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:18 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-5807e84e-700d-4ac1-8065-7fbe6783b0e5" returned: 0 in 0.660s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-5807e84e-700d-4ac1-8065-7fbe6783b0e5" released by "delete_volume" :: held 1.461s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Created reservations ['e2c8e7a0-6bcf-4da4-bf8e-a199fb8cf472', 'beeac7ad-f573-4484-a1ab-97b442c80265', '0f4aaf3d-def4-44bc-8ff8-6a82d02c880c', '3c1e4620-b837-4324-ac3a-e99d8e469396'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:18 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:19 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:56:19 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:19 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:19 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.709s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:19 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:56:19 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Deleted volume successfully. Jul 08 19:56:19 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-ceb78540-4ee3-42f6-b33e-83d5d567ea65 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-5807e84e-700d-4ac1-8065-7fbe6783b0e5-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (43b4ae8c-f2e6-40a8-abf3-4b29947e2826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8c0d94-48ca-4fef-bec9-f338342c6ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8c0d94-48ca-4fef-bec9-f338342c6ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291849898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655b8c91-2249-4687-a7a9-bf04efb4087b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:20Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5813e05-73f7-4407-8c43-2439297040f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5813e05-73f7-4407-8c43-2439297040f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fcf508-3c48-407e-9017-55f38c5396bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fcf508-3c48-407e-9017-55f38c5396bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655b8c91-2249-4687-a7a9-bf04efb4087b', 'volume_name': 'volume-655b8c91-2249-4687-a7a9-bf04efb4087b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceef5e2-a08e-40a2-a5e2-94c2849ae66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ceef5e2-a08e-40a2-a5e2-94c2849ae66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a185b794-4e24-4c94-9ff9-d753120878a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:20 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Volume 655b8c91-2249-4687-a7a9-bf04efb4087b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655b8c91-2249-4687-a7a9-bf04efb4087b', 'volume_size': 1} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-291849898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655b8c91-2249-4687-a7a9-bf04efb4087b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:20Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Creating volume 655b8c91-2249-4687-a7a9-bf04efb4087b {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:56:20 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:20 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b 1073741824 Jul 08 19:56:20 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:20 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b 1073741824" returned: 0 in 0.829s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:20 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:20 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b Jul 08 19:56:20 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:21 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b" returned: 0 in 0.621s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a185b794-4e24-4c94-9ff9-d753120878a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655b8c91-2249-4687-a7a9-bf04efb4087b', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d40749-86ec-4fe4-a712-0c0f341241e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:21 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Volume volume-655b8c91-2249-4687-a7a9-bf04efb4087b (655b8c91-2249-4687-a7a9-bf04efb4087b): created successfully Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d40749-86ec-4fe4-a712-0c0f341241e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:21 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (43b4ae8c-f2e6-40a8-abf3-4b29947e2826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:21 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-0539b4db-ad41-4b11-b9bf-a61f3a7ecdb2 tempest-ProjectReaderTests-1095006254 None] Created volume successfully. Jul 08 19:56:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-655b8c91-2249-4687-a7a9-bf04efb4087b-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-655b8c91-2249-4687-a7a9-bf04efb4087b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-quobyte-655b8c91-2249-4687-a7a9-bf04efb4087b" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:22 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-655b8c91-2249-4687-a7a9-bf04efb4087b" acquired by "delete_volume" :: waited 0.014s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:22 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a835f55-0664-4f84-8168-7b070e07b2b2]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:22 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:22 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b Jul 08 19:56:22 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:23 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b" returned: 0 in 0.799s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:23 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b Jul 08 19:56:23 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:23 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-655b8c91-2249-4687-a7a9-bf04efb4087b" returned: 0 in 0.707s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-655b8c91-2249-4687-a7a9-bf04efb4087b" released by "delete_volume" :: held 1.544s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Created reservations ['ee08c858-3980-4ad9-b27e-83ef4a088ff9', 'c81e9808-e165-4c55-93da-100cd4c98830', '9667ef39-4c77-4d56-ac6d-03dc1c5b2dd3', 'b05665ef-b99c-4530-a703-be9cc5ae9381'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:23 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:23 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:56:23 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:24 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.634s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:56:24 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Deleted volume successfully. Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e061fa6c-b929-4e57-a249-f296c724c8a9 tempest-ProjectReaderTests-1095006254 None] Lock "cinder-655b8c91-2249-4687-a7a9-bf04efb4087b-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87172) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1543}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (2a2a492a-bb72-4ebc-a202-ab4b300b3554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ba76ee-4539-4df4-b281-fb6ed745d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ba76ee-4539-4df4-b281-fb6ed745d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452261604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec838e5c-7530-4025-8d81-b1f777b38b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:25Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06eb8622-edf0-461a-b059-7fab1a0a1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06eb8622-edf0-461a-b059-7fab1a0a1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a77b116-1d58-4311-bbf5-cff51710d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a77b116-1d58-4311-bbf5-cff51710d743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec838e5c-7530-4025-8d81-b1f777b38b1c', 'volume_name': 'volume-ec838e5c-7530-4025-8d81-b1f777b38b1c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82ecac7-79c2-4e26-8439-dc11dd62c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82ecac7-79c2-4e26-8439-dc11dd62c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adc4bc3-14aa-4beb-9f52-9c8f34213460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:24 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Volume ec838e5c-7530-4025-8d81-b1f777b38b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec838e5c-7530-4025-8d81-b1f777b38b1c', 'volume_size': 1} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T17:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452261604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec838e5c-7530-4025-8d81-b1f777b38b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878de3a1a52546d39a40a7e697010aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T17:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T17:56:25Z,use_quota=True,user_id='6f4c8966d9d04ec2bb56e423416ebf43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d959ce6-bcb1-4322-9056-d887e14f5749),volume_type_id=2d959ce6-bcb1-4322-9056-d887e14f5749)}" {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.remotefs [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Creating volume ec838e5c-7530-4025-8d81-b1f777b38b1c {{(pid=87172) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Selected osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc as target Quobyte volume. {{(pid=87172) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 19:56:24 devstack cinder-volume[87172]: INFO cinder.volume.drivers.remotefs [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] casted to osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc Jul 08 19:56:24 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c 1073741824 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:24 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c 1073741824 Jul 08 19:56:24 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:25 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c 1073741824" returned: 0 in 0.852s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:25 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:25 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c Jul 08 19:56:25 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:26 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c" returned: 0 in 0.613s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'} {{(pid=87172) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adc4bc3-14aa-4beb-9f52-9c8f34213460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec838e5c-7530-4025-8d81-b1f777b38b1c', 'volume_size': 1}' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3abafff-19fc-4e0c-8a27-b348fa7184e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 19:56:26 devstack cinder-volume[87172]: INFO cinder.volume.flows.manager.create_volume [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Volume volume-ec838e5c-7530-4025-8d81-b1f777b38b1c (ec838e5c-7530-4025-8d81-b1f777b38b1c): created successfully Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3abafff-19fc-4e0c-8a27-b348fa7184e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87172) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Flow 'volume_create_manager' (2a2a492a-bb72-4ebc-a202-ab4b300b3554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87172) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 19:56:26 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-c39ff5c3-e9a4-49bd-ba52-6d62ac7d2679 tempest-ProjectReaderTests-1095006254 None] Created volume successfully. Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-ec838e5c-7530-4025-8d81-b1f777b38b1c-delete_volume" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Lock "cinder-ec838e5c-7530-4025-8d81-b1f777b38b1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Acquiring lock "cinder-quobyte-ec838e5c-7530-4025-8d81-b1f777b38b1c" by "delete_volume" {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-ec838e5c-7530-4025-8d81-b1f777b38b1c" acquired by "delete_volume" :: waited 0.015s {{(pid=87172) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd24edc-1fcc-45be-9cfc-9827d25e9a2d]: (4, 'qcow2') {{(pid=88217) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 19:56:26 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:27 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c Jul 08 19:56:27 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:27 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c" returned: 0 in 0.722s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:27 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:27 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c Jul 08 19:56:27 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:28 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989/volume-ec838e5c-7530-4025-8d81-b1f777b38b1c" returned: 0 in 0.618s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Lock "cinder-quobyte-ec838e5c-7530-4025-8d81-b1f777b38b1c" released by "delete_volume" :: held 1.378s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG cinder.quota [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Created reservations ['a2308e24-42ce-444b-adbe-a93a0102517f', 'f4c0d27b-849e-4ece-8d85-77ff9b5fbffb', '5470419f-a270-4064-92e4-be74848b1a73', '69442a87-c7d8-48fb-bcd6-eda2b9bd6793'] {{(pid=87172) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:28 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:28 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:56:28 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:29 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:29 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.622s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:29 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:56:29 devstack cinder-volume[87172]: INFO cinder.volume.manager [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Deleted volume successfully. Jul 08 19:56:29 devstack cinder-volume[87172]: DEBUG cinder.coordination [None req-e73849ec-391f-402c-a64e-a324516002fe tempest-ProjectReaderTests-1095006254 None] Lock "cinder-ec838e5c-7530-4025-8d81-b1f777b38b1c-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=87172) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc': None} {{(pid=87172) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG cinder.volume.drivers.quobyte [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b0e6084c-289a-4310-ab56-0830222562fc'] {{(pid=87172) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.lockutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87172) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 19:56:34 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 19:56:34 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989 Jul 08 19:56:34 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 19:56:35 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jul 08 19:56:35 devstack cinder-volume[87172]: DEBUG oslo_concurrency.processutils [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0c73e0c074854113c6a9da921a3b4989" returned: 0 in 0.639s {{(pid=87172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 19:56:35 devstack cinder-volume[87172]: DEBUG cinder.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Notifying Schedulers of capabilities ... {{(pid=87172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 19:56:35 devstack cinder-volume[87172]: DEBUG oslo_service.periodic_task [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] Running periodic task VolumeManager._thread_info {{(pid=87172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 19:56:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread count: 28 {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5482}} Jul 08 19:56:35 devstack cinder-volume[87172]: DEBUG cinder.volume.manager [None req-6d6d1b9c-f7e6-47e9-a964-e1802693f716 None None] thread info: [<_MainThread(MainThread, started 127420814573696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5483}} Jul 08 19:56:38 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:INSERT=14,cinder:UPDATE=55,cinder:SELECT=33,cinder:DELETE=4 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:56:39 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=40,cinder:INSERT=14,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:56:51 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:SELECT=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 19:56:51 devstack cinder-volume[87172]: DEBUG dbcounter [-] [87172] Writing DB stats cinder:UPDATE=1 {{(pid=87172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}